-- Logs begin at Sun 2022-10-30 00:10:48 UTC, end at Sun 2022-10-30 01:26:54 UTC. -- Oct 30 01:00:02.687310 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 30 01:00:02.697430 dv-cinder-master-3-smb devstack@n-api.service[104439]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 01:00:02 2022] *** Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: nodename: dv-cinder-master-3-smb Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: machine: x86_64 Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: clock source: unix Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: pcre jit disabled Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: detected number of CPU cores: 4 Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: current working directory: / Oct 30 01:00:02.699378 dv-cinder-master-3-smb devstack@n-api.service[104439]: detected binary path: /usr/bin/uwsgi-core Oct 30 01:00:02.700160 dv-cinder-master-3-smb devstack@n-api.service[104439]: your processes number limit is 47680 Oct 30 01:00:02.700160 dv-cinder-master-3-smb devstack@n-api.service[104439]: your memory page size is 4096 bytes Oct 30 01:00:02.700160 dv-cinder-master-3-smb devstack@n-api.service[104439]: detected max file descriptor number: 2048 Oct 30 01:00:02.700160 dv-cinder-master-3-smb devstack@n-api.service[104439]: lock engine: pthread robust mutexes Oct 30 01:00:02.700160 dv-cinder-master-3-smb devstack@n-api.service[104439]: thunder lock: enabled Oct 30 01:00:02.700160 dv-cinder-master-3-smb devstack@n-api.service[104439]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 30 01:00:02.700160 dv-cinder-master-3-smb devstack@n-api.service[104439]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 01:00:02.739638 dv-cinder-master-3-smb devstack@n-api.service[104439]: Python main interpreter initialized at 0x5643834809c0 Oct 30 01:00:02.739638 dv-cinder-master-3-smb devstack@n-api.service[104439]: python threads support enabled Oct 30 01:00:02.739638 dv-cinder-master-3-smb devstack@n-api.service[104439]: your server socket listen backlog is limited to 100 connections Oct 30 01:00:02.739638 dv-cinder-master-3-smb devstack@n-api.service[104439]: your mercy for graceful operations on workers is 90 seconds Oct 30 01:00:02.740025 dv-cinder-master-3-smb devstack@n-api.service[104439]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 01:00:02.740101 dv-cinder-master-3-smb devstack@n-api.service[104439]: *** Operational MODE: preforking *** Oct 30 01:00:02.740316 dv-cinder-master-3-smb devstack@n-api.service[104439]: *** uWSGI is running in multiple interpreter mode *** Oct 30 01:00:02.740316 dv-cinder-master-3-smb devstack@n-api.service[104439]: spawned uWSGI master process (pid: 104439) Oct 30 01:00:02.740525 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 30 01:00:02.741757 dv-cinder-master-3-smb devstack@n-api.service[104439]: spawned uWSGI worker 1 (pid: 104440, cores: 1) Oct 30 01:00:02.741903 dv-cinder-master-3-smb devstack@n-api.service[104439]: spawned uWSGI worker 2 (pid: 104441, cores: 1) Oct 30 01:00:02.742059 dv-cinder-master-3-smb devstack@n-api.service[104439]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 01:00:03.414318 dv-cinder-master-3-smb devstack@n-api.service[104440]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:00:03.426908 dv-cinder-master-3-smb devstack@n-api.service[104441]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:00:04.495237 dv-cinder-master-3-smb devstack@n-api.service[104440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:00:04.495237 dv-cinder-master-3-smb devstack@n-api.service[104440]: from cryptography.utils import int_from_bytes Oct 30 01:00:04.495876 dv-cinder-master-3-smb devstack@n-api.service[104440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:00:04.495876 dv-cinder-master-3-smb devstack@n-api.service[104440]: from cryptography.utils import int_from_bytes Oct 30 01:00:04.499799 dv-cinder-master-3-smb devstack@n-api.service[104441]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:00:04.499799 dv-cinder-master-3-smb devstack@n-api.service[104441]: from cryptography.utils import int_from_bytes Oct 30 01:00:04.500257 dv-cinder-master-3-smb devstack@n-api.service[104441]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:00:04.500257 dv-cinder-master-3-smb devstack@n-api.service[104441]: from cryptography.utils import int_from_bytes Oct 30 01:00:07.002200 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:00:07.002754 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:00:07.002900 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:00:07.003255 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:00:07.003504 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:00:07.003919 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.004239 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.004552 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.004865 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.005190 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.005515 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:00:07.005949 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.005949 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.006093 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:00:07.006161 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.006390 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:00:07.006496 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.006914 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.007016 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:00:07.007232 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.007327 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:00:07.007549 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.007675 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.007894 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.007997 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.008196 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.008282 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.008500 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.008598 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.008812 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.008912 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.009107 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.009195 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.009422 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.009524 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.009744 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.009840 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.010157 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.010242 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.010707 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.010840 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.010960 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.011075 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.011188 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.011294 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.011407 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.011621 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.011780 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.011916 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.012060 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.012178 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.012312 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.012482 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.012575 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.012782 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.012872 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.013103 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.013190 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.013404 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.013609 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.013807 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.013904 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.014120 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.014207 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.014427 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.014521 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.014739 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.014842 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.015105 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.015191 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.015408 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.015494 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.015815 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.015932 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.016072 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.016208 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.016989 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.017101 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.017274 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.017388 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.017595 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.017791 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.017907 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.018107 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.018220 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.018421 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.018518 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.018730 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.018828 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.019105 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.019202 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.019404 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.019502 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.019756 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.019929 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.020067 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.020166 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.020308 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.020404 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.020541 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.020666 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023175 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023404 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023502 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023663 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023775 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023860 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023971 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.023971 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024130 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024211 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024299 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024379 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024525 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024608 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024698 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024778 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024868 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.024948 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025035 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025197 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025281 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025360 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025437 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025522 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025608 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025699 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025780 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025858 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.025936 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026014 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026092 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026092 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026247 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026388 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026544 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026635 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026734 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026826 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026907 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.026986 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.027071 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.027220 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.027372 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.027514 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.027679 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.027815 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.027951 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.028092 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.028254 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.028400 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.028546 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.028684 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.028819 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.028974 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.029109 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.029247 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.029412 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.029554 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.029696 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.029865 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.030019 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.030160 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.030313 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.030456 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.030676 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.030676 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.030957 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.031098 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.031238 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.031380 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.031526 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.031751 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.031909 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.032056 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.032197 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.032329 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.032529 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.032719 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.032867 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.032994 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033090 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033172 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033273 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033363 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033451 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033532 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033622 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033703 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.033902 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.034022 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.034243 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.034338 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.034539 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.034626 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.034834 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.034930 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.035131 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.035234 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.035428 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.035515 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.035747 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.035838 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.036047 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.036167 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.036347 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.036444 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.036735 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.036837 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.036939 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.037026 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.037233 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.037334 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.037530 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.037638 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.037827 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.037921 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.038138 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.038254 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.038454 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.038543 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.038749 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.038837 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.039048 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.039148 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.039344 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.039430 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.039666 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.039768 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.039979 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.040084 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.040278 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.040397 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.040577 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.040725 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.040890 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.041018 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.041177 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.041267 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.041474 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.041563 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.041783 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.041878 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.042079 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.042165 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.042374 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.042465 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.042721 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.042832 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.042955 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.043043 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.043246 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.043334 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.043540 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.043687 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.043878 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.043965 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.044175 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.044264 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.044468 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.044557 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.044779 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.044870 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.045092 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.045178 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.045393 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.045481 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.045690 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.045777 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.045988 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.046076 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.046286 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.046373 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.046585 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.046672 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.046892 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.047064 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.047170 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.047262 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.047469 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.048112 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.048410 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.048532 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.048736 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.048844 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.049037 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.049156 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.049339 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.049463 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.049646 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.049742 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.049950 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.050044 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.050254 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.050370 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.050616 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.050716 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.050898 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:00:07.050989 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.051208 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.051356 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.051520 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.051676 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.051893 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.051995 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.052178 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.052267 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.052485 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.052574 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.052854 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.052956 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.053096 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.053186 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.053408 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.053507 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.053716 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.053811 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.054031 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.054119 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.054333 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.054428 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.054636 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.054723 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.054946 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.055067 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.055263 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.055371 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.055579 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.055708 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.055922 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.056011 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.056232 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.056319 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.056535 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.056642 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.056840 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.057015 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.057161 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.057259 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.057476 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.057579 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.057778 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.057867 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.058089 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.058175 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.058395 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.058490 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.058711 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.058798 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.059016 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.059102 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.059322 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.059447 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.059644 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.059735 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.059950 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.060044 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.060253 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.060356 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.060590 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.060683 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.060898 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.060986 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.061244 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.061344 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.061552 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.061648 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.061859 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.061945 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.062170 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.062265 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.062477 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.062565 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.062784 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.062898 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.063089 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.063244 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.063995 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.064125 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.064259 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.064439 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.064559 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.064750 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.064864 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.065058 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.065148 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.065395 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.065484 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.065708 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.065798 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.066031 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.066118 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.066346 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.066435 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.066919 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.067056 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.067183 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.067294 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.067386 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.067468 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.067697 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.067823 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.068000 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.068120 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.068309 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.068408 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.068611 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.068710 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.068909 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.069014 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.069220 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.069315 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.069522 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.069616 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.069820 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.069927 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.070135 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.070232 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.070435 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.070533 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.070736 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.070854 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.071045 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.071154 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.071346 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.071434 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.071671 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.071763 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.071978 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.072080 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.072279 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.072366 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.072585 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.072673 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.072890 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.072988 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.073268 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.073371 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.073539 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.073623 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.073796 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.073884 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.074096 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.074197 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.074413 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.074594 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.074732 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.074857 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.075041 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.075171 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.075338 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.075490 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.075664 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.075829 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.075961 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.076143 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.076266 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.076456 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.076565 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.076798 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.076887 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.077131 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.077296 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.077451 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.077545 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.077737 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.077865 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.078016 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.078106 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.078338 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.078443 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.078656 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.078755 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.078988 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.079083 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.079287 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.079409 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.079616 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.079750 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.079903 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.080054 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.080241 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.080433 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.080520 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.080739 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.080861 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.081045 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.081193 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.081358 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.081507 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.081705 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.081822 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.082010 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.082127 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.082313 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.082436 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.082615 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.082738 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.082918 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.083041 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.083225 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.083361 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.083669 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.083832 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.083933 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.084077 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.084228 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.084378 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.084532 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.084682 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.084827 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.084972 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.085156 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.085310 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.085449 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.085586 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.085758 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.085893 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.086064 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.086208 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.086374 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.086510 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.086709 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.086856 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.087038 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.087177 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.087347 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.087483 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.087684 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.087822 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.087990 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.088127 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.088299 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.088449 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.088587 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.088733 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.088881 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.089019 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.089164 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.089302 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.089466 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.089606 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.089811 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.089945 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.090118 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.090257 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.090413 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.090561 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.090719 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.090853 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.091059 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.091201 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.091339 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.091442 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.091673 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.091766 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.091974 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.092061 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.092283 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.092381 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.092628 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.092741 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.092934 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.093034 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.093235 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.093353 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.093541 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.093632 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.093855 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.094004 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.094145 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.094292 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.094465 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.094605 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.094812 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.094959 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.095106 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.095250 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.095387 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.095523 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.095691 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.095830 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.096003 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.096142 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.096300 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.096448 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.096592 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.096733 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.096878 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.097015 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.097174 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.097320 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.097476 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.097639 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.097773 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.097973 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.098063 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.098281 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.098380 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.098590 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.098680 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.098910 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.098998 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.099221 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.099309 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.099527 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.099644 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.099859 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.099945 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.100155 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.100256 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.100457 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.100544 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.100759 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.100844 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.101077 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.101164 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.101378 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.101466 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.101675 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.101762 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.101999 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.102172 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.102300 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.102387 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.102597 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.102684 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.102894 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.102989 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.103192 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.103283 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.103494 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.103643 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.103830 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.103940 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.104131 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.104220 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.104431 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.104520 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.104746 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.104888 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.105052 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.105140 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.105351 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.105438 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.105655 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.105744 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.105958 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.106044 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.106264 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.106352 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.106565 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.106654 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.106903 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.106990 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.107206 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.107303 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.107511 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.107658 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.107838 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.107926 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.108135 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.108221 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.108437 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.108529 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.108745 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.108841 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.109117 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.109326 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.109434 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.109661 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.109757 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.109973 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.110084 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.110905 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.111005 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.111208 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.111296 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.111517 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.111673 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.111857 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.112001 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.112210 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.112338 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.112564 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.112699 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.112884 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.113064 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.113189 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.113286 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.113490 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.113577 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.113790 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.113934 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.114099 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.114189 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.114383 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.114470 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.114684 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.114781 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.114984 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.115261 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.115356 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.115569 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.115750 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.115886 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.115981 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.116187 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.116296 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.116485 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.116585 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.116794 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.116893 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.117092 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.117195 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.117394 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.117482 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.117691 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.117780 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.118008 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.118096 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.118312 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.118407 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.118608 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.118698 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.118905 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.119016 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.119201 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.119291 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.119514 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.119648 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.119846 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.119952 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.120149 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.120251 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.120456 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.120552 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.120755 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.120843 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.121056 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.121180 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.121355 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.121446 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.121655 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.121746 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.121966 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.122062 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.122262 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.122350 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.122559 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.122656 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.122857 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.122952 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.123156 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.123243 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.123453 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.123540 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.123782 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.123873 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.124083 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.124215 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.124382 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.124473 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.124681 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.124768 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.124978 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.125083 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.125278 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.125417 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.125575 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.126396 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.126499 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.126741 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.126828 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.127037 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.127209 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.127333 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.127422 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.127657 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.127750 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.127960 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.128098 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.128255 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.128343 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.128554 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.128687 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.128848 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.128937 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.129154 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.129249 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.129449 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.129536 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.129770 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.129860 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.130067 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.130154 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.130368 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.130456 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.130666 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.130755 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.130960 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.131047 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.131275 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.131376 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.131577 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.131963 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.132160 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.132250 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.132456 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.132557 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.132759 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.132847 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.133056 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.133143 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.133353 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.133450 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.133657 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.133745 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.133974 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.134060 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.134281 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.134426 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.134576 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.134683 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.134876 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.134965 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.135199 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.135298 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.135498 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.135665 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.135817 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.135905 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.136130 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.136265 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.136434 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.136736 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.136878 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.137061 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.137423 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.137717 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.137968 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138232 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138307 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138373 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138450 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138517 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138583 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138669 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138768 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.138858 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.139070 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.139167 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.139371 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.139468 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.139693 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.139799 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.140020 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.140125 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.140319 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.140406 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.140618 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.140724 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.140920 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.141017 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.141223 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.141320 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.142096 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.142202 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.142402 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.142489 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.142707 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.142795 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.143015 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.143112 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.143314 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.143409 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.143634 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.143742 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.143941 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.144028 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.144271 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.144465 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.144607 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.144765 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.144916 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.145055 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.145201 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.145343 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.145477 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.145614 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.145761 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.145910 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.146055 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.146200 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.146339 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.146480 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.146627 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.146764 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.146900 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.147044 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.147185 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.147332 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.147476 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.147704 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.147868 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.148006 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.148144 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.148312 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.148449 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.148603 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.148737 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.148893 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.149025 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.149171 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.149306 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.149450 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.149604 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.149740 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.149876 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150027 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150162 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150306 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150453 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150596 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150741 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150905 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.150994 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.151223 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.151310 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.151545 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.151692 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.151867 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.151954 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.152169 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.152260 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.152466 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.152566 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.152793 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.152881 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.153091 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.153178 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.153415 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.153533 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.153721 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.153842 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.154029 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.154147 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.154335 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.154472 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.154642 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.154733 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.155023 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.155111 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.155328 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.155415 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.155661 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.155754 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.155960 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.156048 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.156261 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.156359 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.156585 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.156673 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.156887 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.156998 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.157834 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.157931 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.158188 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.158284 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.158492 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.158637 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.158802 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.158892 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.159104 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.159193 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.159405 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.159543 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.159728 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.159880 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.160026 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.160188 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.160342 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.160491 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.160639 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.160805 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.160953 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.161111 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.161372 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.161470 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.161676 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.161763 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.161974 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.162070 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.162381 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.162475 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.162686 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.162773 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.162990 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.163085 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.163296 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.163384 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.163615 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.163705 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.163923 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.164014 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.164218 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.164308 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.164530 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.164656 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.164951 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.165053 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.165147 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.165230 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.165417 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.165505 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.165733 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.165832 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.166035 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.166162 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.166332 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.166420 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.166653 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.166765 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.166985 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.167238 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.167337 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.167420 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.167578 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.167797 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.168019 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.168128 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.168333 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.168423 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.168641 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.168729 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.168958 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.169075 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.169278 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.169369 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.169578 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.169667 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.169876 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.169974 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.170183 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.170275 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.170481 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.170571 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.170780 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.170877 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.171099 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.171211 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.171402 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.171499 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.171736 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.171831 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.172042 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.172131 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.172347 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.172456 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.172671 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.172787 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.172970 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.173108 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.173287 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.173534 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.173634 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.173853 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.173948 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.174162 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.174260 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.174482 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.174573 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.174797 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.174932 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.175093 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.175195 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.175428 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.175537 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.175761 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.175854 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.176060 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.176167 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.176360 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.176457 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.176663 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.176760 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.176964 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.177050 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.177272 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.177370 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.177579 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.177668 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.177903 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.177999 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.178224 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.178313 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.178526 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.178622 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.178844 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.178953 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.179141 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.179229 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.179457 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.179543 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.179783 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.179887 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.180095 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.180192 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.180410 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.180504 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.180706 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.180807 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.181111 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.181264 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.181496 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.181649 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.181802 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.181945 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.182090 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.182228 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.182319 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.182501 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.182647 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.182786 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.182924 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.183069 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.183205 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.183342 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.183527 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.183654 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.183879 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.183976 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.184186 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.184274 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.184506 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.184602 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.184809 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.184954 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.185107 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.185205 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.185404 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.185500 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.185700 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.185790 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.186023 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.186120 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.186419 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.186533 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.186617 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.186696 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.186913 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.187012 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.187210 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.187298 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.187510 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.187626 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.187837 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.187929 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.188140 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.188250 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.188487 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.188574 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.188784 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.188873 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.189083 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.189182 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.189388 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.189475 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.189683 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.189771 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.189988 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.190076 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.190291 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.190379 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.190589 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.190754 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.190895 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.191158 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.191285 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.191482 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.191678 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.191814 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.191905 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.192121 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.192210 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.192428 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.192519 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.192736 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.192824 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.193043 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.193131 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.193347 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.193438 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.193650 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.193737 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.193952 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.194040 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.194254 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.194344 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.194561 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.194661 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.194873 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.195010 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.195178 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.195265 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.195488 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.195577 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.195827 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.196005 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.196135 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.196222 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.196459 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.196699 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.196790 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.197025 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.197115 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.197338 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.197427 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.197648 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.197747 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.197957 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.198046 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.198263 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.198357 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.198568 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.198666 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.198871 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.198959 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.199182 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.199301 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.199479 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.199579 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.199809 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.199901 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.200113 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.200201 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.200414 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.200503 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.200800 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.200897 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.201116 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.201212 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.201446 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.201552 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.201792 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.201895 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.202077 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.202175 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.202384 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.202487 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.202691 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.202786 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.202999 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.203113 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.203364 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.203560 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.203692 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.204450 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.204632 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.204844 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.204934 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.205167 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.205256 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.205489 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.205591 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.205804 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.205895 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.206116 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.206203 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.206474 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.206572 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.206779 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.206877 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.207079 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.207175 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.207385 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.207481 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.207710 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.207802 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.208011 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.208111 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.208327 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.208417 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.208633 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.208720 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.208935 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.209022 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.209250 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.209902 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.209902 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.210204 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.210347 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.210487 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.210698 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.210849 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.210996 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.211133 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.211281 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.211419 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.211565 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.211721 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.211861 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212009 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212106 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212198 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212280 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212359 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212534 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212662 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212832 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.212972 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.213140 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.213277 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.213445 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.213579 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.213811 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.213907 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.214191 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.214278 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.214495 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.214583 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.214794 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.214894 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.215104 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.215206 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.215422 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.215687 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.215802 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.216035 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.216125 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.216349 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.216440 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.216674 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.216791 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.216999 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.217113 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.217313 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.217410 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.217612 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.217721 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.217921 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.218018 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.218289 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.218385 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.218590 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.218696 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.218896 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.218993 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.219202 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.219327 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.220113 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.220218 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.220383 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.220495 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.220690 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.220787 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.221038 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.221137 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.221363 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.221461 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.221768 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.221880 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.221979 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.222068 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.222268 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.222373 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.222563 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.222660 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.222864 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.222971 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.223166 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.223271 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.223478 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.223687 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.223784 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.223877 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.224094 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.224191 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.224393 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.224498 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.224692 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.224789 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.224999 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.225298 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.225393 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.225607 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.225718 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.225907 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.226006 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.226216 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.226304 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.226561 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.226652 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.226863 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.226951 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.227166 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.227278 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.227467 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.227565 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.227809 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.227918 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.228111 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.228208 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.228415 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.228504 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.228718 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.228805 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.229020 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.229122 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.229322 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.229421 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.229625 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.229721 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.229925 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.230031 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.230225 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.230314 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.230526 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.230825 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.230920 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.231125 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.231229 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.231426 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.231513 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.231749 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.231865 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.232054 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.232212 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.232583 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.232730 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.232891 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.233039 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.233198 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.233333 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.233496 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.233677 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.233826 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.233963 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.234099 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.234243 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.234383 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.234536 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.234688 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.234820 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.234966 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.235718 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.235891 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236000 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236093 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236176 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236256 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236337 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236531 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236636 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236830 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.236918 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.237222 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.237526 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.237673 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.237832 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.237966 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.238112 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.238251 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.238416 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.238551 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.238746 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.238878 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.239063 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.239200 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.239376 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.239515 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.239720 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.239819 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.240009 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.240102 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.240313 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.240410 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.240619 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.240705 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.240923 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.241010 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.241230 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.241333 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.241543 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.241630 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.241868 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.241957 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.242187 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.242367 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.242505 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.242646 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.242821 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.243135 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.243277 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.243427 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.243565 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.243771 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.243912 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.244045 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.244191 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.244330 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.244502 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.244648 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.244824 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.244965 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.245146 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.245287 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.245454 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.245588 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.245738 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.245886 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246021 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246107 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246316 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246404 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246616 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246712 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246910 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.246998 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.247204 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.247314 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.247499 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.247632 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.247820 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.247932 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.248114 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.248234 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.248410 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.248541 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.248705 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.248857 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.249000 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.249147 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.249295 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.249451 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.249618 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.249818 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.250036 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.250183 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.250402 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.250611 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.250848 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.251557 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.251740 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.251872 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252031 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252125 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252271 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252423 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252510 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252590 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252683 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252805 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.252917 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.253086 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.253220 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.253387 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.253549 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.253687 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.253848 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.253987 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.254153 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.254293 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.254462 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.254609 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.254766 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.254902 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.255068 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.255214 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.255369 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.255500 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.255711 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.255843 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.256139 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.256277 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.256418 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.256553 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.256932 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.257070 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.257223 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.257373 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.257548 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.257681 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.257772 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.257924 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.258115 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.258254 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.258409 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.258550 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.258696 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.258835 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.258981 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.259119 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.259256 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.259423 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.259559 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.259780 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.259974 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.260114 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.260254 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.260391 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.260528 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.260674 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.260815 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.261012 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.261205 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.261405 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.261607 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.261607 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.262007 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.262007 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.262334 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.262485 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.262631 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.262772 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.262921 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263056 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263257 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263257 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263546 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263546 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263710 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263791 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.263884 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.264033 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.264146 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.264361 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.264458 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.264662 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.264751 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.264959 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.265048 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.265198 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:00:07.265294 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.265555 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.265860 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.266173 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.266619 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.266933 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.267245 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.267555 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.267912 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.268236 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.268540 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.268861 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.269181 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.269524 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.269835 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.270175 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.270498 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.270809 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.271118 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.271418 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:00:07.271684 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:00:07.419175 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO dbcounter [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Registered counter for database nova_api Oct 30 01:00:07.428223 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO dbcounter [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Registered counter for database nova_api Oct 30 01:00:07.441681 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_db.sqlalchemy.engines [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.448426 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_db.sqlalchemy.engines [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.448613 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writer thread running {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:07.455316 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writer thread running {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:07.506904 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.context [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),981e4b1c-a815-41e8-a403-49a91c7c17f9(cell1) {{(pid=104440) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:00:07.510692 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:07.511159 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:07.512827 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:07.513534 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:07.513971 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:07.514794 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.context [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),981e4b1c-a815-41e8-a403-49a91c7c17f9(cell1) {{(pid=104441) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:00:07.516025 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:07.518590 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO dbcounter [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Registered counter for database nova_cell0 Oct 30 01:00:07.519280 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_concurrency.lockutils [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:07.519781 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_concurrency.lockutils [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:07.521379 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_concurrency.lockutils [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:07.522099 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_concurrency.lockutils [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:07.522536 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_concurrency.lockutils [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:07.522678 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO dbcounter [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Registered counter for database nova_cell1 Oct 30 01:00:07.524581 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_concurrency.lockutils [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:07.526579 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO dbcounter [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Registered counter for database nova_cell0 Oct 30 01:00:07.530271 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_db.sqlalchemy.engines [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.531068 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO dbcounter [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Registered counter for database nova_cell1 Oct 30 01:00:07.532077 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_db.sqlalchemy.engines [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.538288 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_db.sqlalchemy.engines [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.538600 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writer thread running {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:07.540122 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writer thread running {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:07.540484 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_db.sqlalchemy.engines [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.545084 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writer thread running {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:07.550865 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writer thread running {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:07.686555 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO dbcounter [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Registered counter for database nova_cell0 Oct 30 01:00:07.694383 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_db.sqlalchemy.engines [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.696959 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO dbcounter [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Registered counter for database nova_cell0 Oct 30 01:00:07.699365 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writer thread running {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:07.706227 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG oslo_db.sqlalchemy.engines [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:00:07.711174 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writer thread running {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:00:08.104751 dv-cinder-master-3-smb devstack@n-api.service[104440]: WARNING keystonemiddleware.auth_token [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:00:08.112548 dv-cinder-master-3-smb devstack@n-api.service[104440]: WARNING keystonemiddleware.auth_token [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:00:08.148561 dv-cinder-master-3-smb devstack@n-api.service[104441]: WARNING keystonemiddleware.auth_token [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:00:08.156583 dv-cinder-master-3-smb devstack@n-api.service[104441]: WARNING keystonemiddleware.auth_token [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:00:08.455836 dv-cinder-master-3-smb devstack@n-api.service[104440]: WARNING keystonemiddleware.auth_token [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:00:08.462091 dv-cinder-master-3-smb devstack@n-api.service[104440]: WARNING keystonemiddleware.auth_token [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:00:08.467575 dv-cinder-master-3-smb devstack@n-api.service[104440]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643834809c0 pid: 104440 (default app) Oct 30 01:00:08.469739 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:08.470933 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001811 Oct 30 01:00:08.471334 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sun Oct 30 01:00:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:08.519356 dv-cinder-master-3-smb devstack@n-api.service[104441]: WARNING keystonemiddleware.auth_token [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:00:08.525368 dv-cinder-master-3-smb devstack@n-api.service[104441]: WARNING keystonemiddleware.auth_token [None req-59511618-452c-4d95-a1c8-ca4c883d9366 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:00:08.531528 dv-cinder-master-3-smb devstack@n-api.service[104441]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643834809c0 pid: 104441 (default app) Oct 30 01:01:35.338479 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:35.340137 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Oct 30 01:01:35.340810 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:35.353141 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_api:SELECT=3 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:35.354181 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_cell1:SELECT=3 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:35.355268 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_cell0:SELECT=3 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:35.356410 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:36.249555 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-950fd50e-1922-4209-b62e-beb6c385ab58 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:36.284434 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-950fd50e-1922-4209-b62e-beb6c385ab58 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.936692 Oct 30 01:01:36.285221 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 30 01:01:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:38.988184 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:38.989338 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-909cb103-ee70-4e7c-8e5c-b3d113d946a9 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 30 01:01:38.999673 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:01:39.464890 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-ad478f1b-c8b0-4487-9a9a-c7297acc9d2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "disk": 1, "swap": 0}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:39.558020 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-ad478f1b-c8b0-4487-9a9a-c7297acc9d2c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.561716 Oct 30 01:01:39.558896 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:01:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:01:39.777378 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-a7917bfe-608c-4f05-99f1-82c977025623 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:39.784068 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_api:SELECT=3 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:39.785099 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_cell0:SELECT=3 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:39.785796 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_cell1:SELECT=3 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:39.786495 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:39.899451 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-a7917bfe-608c-4f05-99f1-82c977025623 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.330851 Oct 30 01:01:39.900255 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 30 01:01:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:42.555269 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-ad478f1b-c8b0-4487-9a9a-c7297acc9d2c admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:42.556954 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-ad478f1b-c8b0-4487-9a9a-c7297acc9d2c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Oct 30 01:01:42.557616 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:43.238932 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-b5e3aacb-0052-42a1-9818-b9fa867a9cd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:43.355913 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-b5e3aacb-0052-42a1-9818-b9fa867a9cd1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.791293 Oct 30 01:01:43.356560 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:01:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:01:43.370945 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-bfcf5aa9-5c50-42ee-b6c8-d5c48a112cf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:43.512127 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-bfcf5aa9-5c50-42ee-b6c8-d5c48a112cf3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146356 Oct 30 01:01:43.513024 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 30 01:01:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:46.151113 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-b5e3aacb-0052-42a1-9818-b9fa867a9cd1 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:46.155834 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-b5e3aacb-0052-42a1-9818-b9fa867a9cd1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Oct 30 01:01:46.155834 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:46.610906 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-b0f1af3a-2592-4836-9008-d6dfdc65b2fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:46.697664 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-b0f1af3a-2592-4836-9008-d6dfdc65b2fe admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.537274 Oct 30 01:01:46.698231 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:01:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:01:46.711165 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-5c7c9e08-65d9-4ac9-a9b6-3157daa00645 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:46.847787 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-5c7c9e08-65d9-4ac9-a9b6-3157daa00645 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140161 Oct 30 01:01:46.848339 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 30 01:01:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:49.546083 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-b0f1af3a-2592-4836-9008-d6dfdc65b2fe admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:49.547103 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-b0f1af3a-2592-4836-9008-d6dfdc65b2fe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 30 01:01:49.547507 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:49.986653 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-7db2da2d-0df3-48d7-8171-0709c75849ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:50.072013 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-7db2da2d-0df3-48d7-8171-0709c75849ad admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518118 Oct 30 01:01:50.072732 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:01:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:01:50.085843 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-fe84a823-6c93-4ac3-b8d5-87ced2fb6f9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:50.184035 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-fe84a823-6c93-4ac3-b8d5-87ced2fb6f9a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101968 Oct 30 01:01:50.184625 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 30 01:01:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:52.920763 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-7db2da2d-0df3-48d7-8171-0709c75849ad admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:52.921797 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-7db2da2d-0df3-48d7-8171-0709c75849ad admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Oct 30 01:01:52.922299 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:53.417969 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-7453b3f4-05e1-4ed7-85a7-c7d5e37a9712 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:53.505147 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-7453b3f4-05e1-4ed7-85a7-c7d5e37a9712 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.574363 Oct 30 01:01:53.505961 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:01:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:01:53.520748 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-f5f5082b-6ef8-46b6-b88b-36548b68a123 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:53.624662 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-f5f5082b-6ef8-46b6-b88b-36548b68a123 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108565 Oct 30 01:01:53.625254 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Oct 30 01:01:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:56.296276 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-7453b3f4-05e1-4ed7-85a7-c7d5e37a9712 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:56.297457 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-7453b3f4-05e1-4ed7-85a7-c7d5e37a9712 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Oct 30 01:01:56.297886 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:56.768879 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-04ddd3cd-4e7f-478d-a690-40469b67d98c admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:56.798585 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-04ddd3cd-4e7f-478d-a690-40469b67d98c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.493872 Oct 30 01:01:56.799424 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 30 01:01:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:01:59.526032 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-7453b3f4-05e1-4ed7-85a7-c7d5e37a9712 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:59.527051 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-7453b3f4-05e1-4ed7-85a7-c7d5e37a9712 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 30 01:01:59.527452 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:01:59.948140 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-11524384-5ea9-4753-b9c4-471b07140151 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "1", "swap": 0, "ram": 512, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:00.025004 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-11524384-5ea9-4753-b9c4-471b07140151 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.490774 Oct 30 01:02:00.025559 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:01:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:02:00.037728 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-76a7648d-6def-4934-b3f8-0f5b95b13a18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:00.108350 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-76a7648d-6def-4934-b3f8-0f5b95b13a18 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074315 Oct 30 01:02:00.108942 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 30 01:02:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:02.888699 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-11524384-5ea9-4753-b9c4-471b07140151 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:02.889892 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-11524384-5ea9-4753-b9c4-471b07140151 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Oct 30 01:02:02.890462 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:03.358480 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-8ccf08e9-1337-441b-ae38-1103879a75c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "name": "m1.small", "disk": 20, "rxtx_factor": 1.0}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:03.415362 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-8ccf08e9-1337-441b-ae38-1103879a75c5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.518071 Oct 30 01:02:03.415952 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:02:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:02:03.428922 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-511b2b94-51ea-4ae9-bdbb-194373afccc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:03.516215 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-511b2b94-51ea-4ae9-bdbb-194373afccc6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090704 Oct 30 01:02:03.517278 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 30 01:02:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:02:06.411124 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-8ccf08e9-1337-441b-ae38-1103879a75c5 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:06.413222 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-8ccf08e9-1337-441b-ae38-1103879a75c5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002483 Oct 30 01:02:06.414159 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:02:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:07.196663 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-bd12d2ba-8770-4661-8568-8d0770da8496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "3", "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:07.291671 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-bd12d2ba-8770-4661-8568-8d0770da8496 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.870538 Oct 30 01:02:07.292592 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:02:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:02:07.310239 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-f8751538-031d-4199-8283-0cb93f6b6e22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:07.320550 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:07.466639 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-f8751538-031d-4199-8283-0cb93f6b6e22 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.162867 Oct 30 01:02:07.468653 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 30 01:02:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:11.144429 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-bd12d2ba-8770-4661-8568-8d0770da8496 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:11.146007 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-bd12d2ba-8770-4661-8568-8d0770da8496 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003031 Oct 30 01:02:11.146519 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:02:11.764822 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-f0184b54-5046-4698-8164-90b6d9d56a20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "disk": 80, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:11.836466 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-f0184b54-5046-4698-8164-90b6d9d56a20 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.682714 Oct 30 01:02:11.837442 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:02:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:02:11.858088 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-1c5579a4-2cc5-4a92-980c-dc5ea30e3293 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:11.965466 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-1c5579a4-2cc5-4a92-980c-dc5ea30e3293 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113734 Oct 30 01:02:11.966658 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 30 01:02:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:15.894606 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-f0184b54-5046-4698-8164-90b6d9d56a20 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:15.895535 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-f0184b54-5046-4698-8164-90b6d9d56a20 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 30 01:02:15.895989 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:16.425415 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-efe159cf-8155-44e6-8f39-9a62a6a10533 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "swap": 0, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:16.432067 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:16.526938 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-efe159cf-8155-44e6-8f39-9a62a6a10533 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.623855 Oct 30 01:02:16.531651 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Oct 30 01:02:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:02:16.540581 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-d2fe932b-ef82-4bcf-9ecc-0fb1a251f584 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:16.646294 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-d2fe932b-ef82-4bcf-9ecc-0fb1a251f584 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109527 Oct 30 01:02:16.647015 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Oct 30 01:02:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:32.878237 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-efe159cf-8155-44e6-8f39-9a62a6a10533 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:32.879242 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-efe159cf-8155-44e6-8f39-9a62a6a10533 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 30 01:02:32.879688 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:02:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:32.890828 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:33.298366 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-23ae347e-3077-453d-a155-6a97465056d8 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:33.316559 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-23ae347e-3077-453d-a155-6a97465056d8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.430362 Oct 30 01:02:33.317108 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 30 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:02:34.696740 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-efe159cf-8155-44e6-8f39-9a62a6a10533 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:34.697839 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-efe159cf-8155-44e6-8f39-9a62a6a10533 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 30 01:02:34.698362 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:35.228831 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-e8fbc22b-0b6f-481a-8911-732d74ed2bb1 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:35.234077 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.wsgi [None req-e8fbc22b-0b6f-481a-8911-732d74ed2bb1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-e8fbc22b-0b6f-481a-8911-732d74ed2bb1 admin admin] Request method failure captured: Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: Accept: application/json Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: Accept-Encoding: gzip, deflate Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: Connection: keep-alive Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: Content-Length: 0 Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: Host: 10.222.0.26 Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: Openstack-Api-Version: compute 2.92 Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: Openstack-System-Scope: None Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: User-Agent: python-novaclient Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Auth-Token: gAAAAABjXc0qEb18-OT-umsm8usTHbEApANQOP60HkGscttrIxEYgUlKA-A06Z6VVFymAKJPtpln7PdMuDS1gy1iAsjPctpCW6l9GAPw8rqpDswHcOCDfa593J65q9GqimjGf41uAxfh1s71bQaNzKepB46qiTYcE3tz5o97MQKP-rQBRRSI2mM Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Domain-Id: None Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Domain-Name: None Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Identity-Status: Confirmed Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Is-Admin-Project: True Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Domain-Id: default Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Domain-Name: Default Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Name: admin Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Role: reader,member,admin Oct 30 01:02:35.237424 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Roles: reader,member,admin Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6345a90487264af499b3342614a87ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6345a90487264af499b3342614a87ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant: admin Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant-Name: admin Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User: admin Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Domain-Id: default Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Domain-Name: Default Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Id: e23837cd4788413c9fb97c7f11ede732 Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Name: admin Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: method: > Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: exception: Flavor 42 could not be found. Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: action_args: {'id': '42'} Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:35.239197 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:35.240286 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.241676 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-e8fbc22b-0b6f-481a-8911-732d74ed2bb1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:35.243108 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-e8fbc22b-0b6f-481a-8911-732d74ed2bb1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397804 Oct 30 01:02:35.243108 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 30 01:02:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:35.249104 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-75e54bf5-beab-482d-a999-3e362a132ed8 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:35.271666 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-75e54bf5-beab-482d-a999-3e362a132ed8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026428 Oct 30 01:02:35.272228 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 30 01:02:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:02:35.283949 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-c06aeba4-532b-422b-8b61-6f69ae6dccc3 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:35.305870 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-c06aeba4-532b-422b-8b61-6f69ae6dccc3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027052 Oct 30 01:02:35.306444 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 30 01:02:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:02:35.316203 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-de48ffd1-01ae-4003-af19-b96a0e61b6eb admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:35.322650 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.wsgi [None req-de48ffd1-01ae-4003-af19-b96a0e61b6eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-de48ffd1-01ae-4003-af19-b96a0e61b6eb admin admin] Request method failure captured: Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: Accept: application/json Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: Accept-Encoding: gzip, deflate Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: Connection: keep-alive Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: Content-Length: 0 Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: Host: 10.222.0.26 Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: Openstack-Api-Version: compute 2.92 Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: Openstack-System-Scope: None Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: User-Agent: python-novaclient Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Auth-Token: gAAAAABjXc0qEb18-OT-umsm8usTHbEApANQOP60HkGscttrIxEYgUlKA-A06Z6VVFymAKJPtpln7PdMuDS1gy1iAsjPctpCW6l9GAPw8rqpDswHcOCDfa593J65q9GqimjGf41uAxfh1s71bQaNzKepB46qiTYcE3tz5o97MQKP-rQBRRSI2mM Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Domain-Id: None Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Domain-Name: None Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Identity-Status: Confirmed Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Is-Admin-Project: True Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Domain-Id: default Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Domain-Name: Default Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Name: admin Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Role: reader,member,admin Oct 30 01:02:35.326041 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Roles: reader,member,admin Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6345a90487264af499b3342614a87ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6345a90487264af499b3342614a87ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant: admin Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant-Name: admin Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User: admin Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Domain-Id: default Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Domain-Name: Default Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Id: e23837cd4788413c9fb97c7f11ede732 Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Name: admin Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: method: > Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: exception: Flavor 42 could not be found. Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: action_args: {'id': '42'} Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:35.331663 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:35.332658 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:35.333938 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-de48ffd1-01ae-4003-af19-b96a0e61b6eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:35.335206 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-de48ffd1-01ae-4003-af19-b96a0e61b6eb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015387 Oct 30 01:02:35.335206 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 30 01:02:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:36.549944 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-c06aeba4-532b-422b-8b61-6f69ae6dccc3 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:36.550954 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-c06aeba4-532b-422b-8b61-6f69ae6dccc3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 30 01:02:36.551346 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:37.107226 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-fc4a2a60-f2d0-4013-8849-29defaab397f admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:37.112237 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.wsgi [None req-fc4a2a60-f2d0-4013-8849-29defaab397f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-fc4a2a60-f2d0-4013-8849-29defaab397f admin admin] Request method failure captured: Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: Accept: application/json Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: Accept-Encoding: gzip, deflate Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: Connection: keep-alive Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: Content-Length: 0 Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: Host: 10.222.0.26 Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: Openstack-Api-Version: compute 2.92 Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: Openstack-System-Scope: None Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: User-Agent: python-novaclient Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Auth-Token: gAAAAABjXc0sbkitcPqhLoXexy8FwdOvlYot3xecdl-GTlCOobmj3I9hUUcxdV-k_SJLIaI_GBMjfV1n2H-1Q9hj44O_1i2KY73H6XZ5R9EVjmor1z3wSlsKhMlAcb1p-KsnvIIxh3ToOhiv0R5sX3Z_Esr1SKLWnDGiHc5f-7zkxobF9uCEAm4 Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Domain-Id: None Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Domain-Name: None Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Identity-Status: Confirmed Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Is-Admin-Project: True Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Domain-Id: default Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Domain-Name: Default Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Name: admin Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Role: reader,member,admin Oct 30 01:02:37.113734 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Roles: reader,member,admin Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6345a90487264af499b3342614a87ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6345a90487264af499b3342614a87ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant: admin Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant-Name: admin Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User: admin Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Domain-Id: default Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Domain-Name: Default Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Id: e23837cd4788413c9fb97c7f11ede732 Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Name: admin Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: method: > Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: exception: Flavor 84 could not be found. Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: action_args: {'id': '84'} Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:37.115291 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:37.116384 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.117842 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-fc4a2a60-f2d0-4013-8849-29defaab397f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:37.119079 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-fc4a2a60-f2d0-4013-8849-29defaab397f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.425334 Oct 30 01:02:37.119079 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 30 01:02:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:37.125413 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-19ac97ad-6d90-4ae8-9864-b56ddefcafda admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:37.141335 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-19ac97ad-6d90-4ae8-9864-b56ddefcafda admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020123 Oct 30 01:02:37.141880 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 30 01:02:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:02:37.151388 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-9ebcbeec-de51-47cf-a29d-e90cf2a0a890 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:37.166630 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-9ebcbeec-de51-47cf-a29d-e90cf2a0a890 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018721 Oct 30 01:02:37.167190 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 30 01:02:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:02:37.176419 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-321d2d08-4679-4267-95df-032f9dd9d7ea admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:37.181442 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.wsgi [None req-321d2d08-4679-4267-95df-032f9dd9d7ea admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-321d2d08-4679-4267-95df-032f9dd9d7ea admin admin] Request method failure captured: Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: Accept: application/json Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: Accept-Encoding: gzip, deflate Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: Connection: keep-alive Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: Content-Length: 0 Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: Host: 10.222.0.26 Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: Openstack-Api-Version: compute 2.92 Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: Openstack-System-Scope: None Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: User-Agent: python-novaclient Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Auth-Token: gAAAAABjXc0sbkitcPqhLoXexy8FwdOvlYot3xecdl-GTlCOobmj3I9hUUcxdV-k_SJLIaI_GBMjfV1n2H-1Q9hj44O_1i2KY73H6XZ5R9EVjmor1z3wSlsKhMlAcb1p-KsnvIIxh3ToOhiv0R5sX3Z_Esr1SKLWnDGiHc5f-7zkxobF9uCEAm4 Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Domain-Id: None Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Domain-Name: None Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Identity-Status: Confirmed Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Is-Admin-Project: True Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Domain-Id: default Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Domain-Name: Default Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Name: admin Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Role: reader,member,admin Oct 30 01:02:37.182953 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Roles: reader,member,admin Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6345a90487264af499b3342614a87ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6345a90487264af499b3342614a87ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant: admin Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant-Name: admin Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User: admin Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Domain-Id: default Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Domain-Name: Default Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Id: e23837cd4788413c9fb97c7f11ede732 Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Name: admin Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: method: > Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: exception: Flavor 84 could not be found. Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: action_args: {'id': '84'} Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:37.184541 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:37.185502 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:37.187283 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-321d2d08-4679-4267-95df-032f9dd9d7ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:37.188537 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-321d2d08-4679-4267-95df-032f9dd9d7ea admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011487 Oct 30 01:02:37.188537 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Oct 30 01:02:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:38.411092 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-9ebcbeec-de51-47cf-a29d-e90cf2a0a890 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:38.412136 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-9ebcbeec-de51-47cf-a29d-e90cf2a0a890 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 30 01:02:38.412539 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:38.945683 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-7a36d50b-0b5f-414e-b5b0-96330b4b1f5f admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:38.951622 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.wsgi [None req-7a36d50b-0b5f-414e-b5b0-96330b4b1f5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-7a36d50b-0b5f-414e-b5b0-96330b4b1f5f admin admin] Request method failure captured: Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: Accept: application/json Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: Accept-Encoding: gzip, deflate Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: Connection: keep-alive Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: Content-Length: 0 Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: Host: 10.222.0.26 Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: Openstack-Api-Version: compute 2.92 Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: Openstack-System-Scope: None Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: User-Agent: python-novaclient Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Auth-Token: gAAAAABjXc0u9B5ZYmZ2dho7ymIiz-lzSy6gbhE3Uo8sfiRd0dazjPUdnvHunccQ2XL3nTcLujNXOI2YPNIz-fVNyevrZ4Q9O1D7sRFcqQeMGKCoJJvHen2pFeCOiKHHtxof8HQcZjGYYyu1KuywD5BP4VUbRmG5KGpfiSOPKKVgRq3AoMPLgT0 Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Domain-Id: None Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Domain-Name: None Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Identity-Status: Confirmed Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Is-Admin-Project: True Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Domain-Id: default Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Domain-Name: Default Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Project-Name: admin Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Role: reader,member,admin Oct 30 01:02:38.953661 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Roles: reader,member,admin Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6345a90487264af499b3342614a87ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6345a90487264af499b3342614a87ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant: admin Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-Tenant-Name: admin Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User: admin Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Domain-Id: default Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Domain-Name: Default Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Id: e23837cd4788413c9fb97c7f11ede732 Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: X-User-Name: admin Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: method: > Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: exception: Flavor 451 could not be found. Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: action_args: {'id': '451'} Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:38.955273 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:38.956309 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.957706 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-7a36d50b-0b5f-414e-b5b0-96330b4b1f5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:38.958941 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-7a36d50b-0b5f-414e-b5b0-96330b4b1f5f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.402043 Oct 30 01:02:38.958941 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 30 01:02:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:38.964854 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-2973c926-cad8-4869-84c4-94ef710eb5ae admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:38.980024 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-2973c926-cad8-4869-84c4-94ef710eb5ae admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018707 Oct 30 01:02:38.980560 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 30 01:02:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:02:38.990262 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:39.005419 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018696 Oct 30 01:02:39.005956 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Oct 30 01:02:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:02:39.016000 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-a42d8b72-9555-4ce8-b5da-1dcf116b0427 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:39.020987 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.wsgi [None req-a42d8b72-9555-4ce8-b5da-1dcf116b0427 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-a42d8b72-9555-4ce8-b5da-1dcf116b0427 admin admin] Request method failure captured: Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: Accept: application/json Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: Accept-Encoding: gzip, deflate Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: Connection: keep-alive Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: Content-Length: 0 Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: Host: 10.222.0.26 Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: Openstack-Api-Version: compute 2.92 Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: Openstack-System-Scope: None Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: User-Agent: python-novaclient Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Auth-Token: gAAAAABjXc0u9B5ZYmZ2dho7ymIiz-lzSy6gbhE3Uo8sfiRd0dazjPUdnvHunccQ2XL3nTcLujNXOI2YPNIz-fVNyevrZ4Q9O1D7sRFcqQeMGKCoJJvHen2pFeCOiKHHtxof8HQcZjGYYyu1KuywD5BP4VUbRmG5KGpfiSOPKKVgRq3AoMPLgT0 Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Domain-Id: None Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Domain-Name: None Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Identity-Status: Confirmed Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Is-Admin-Project: True Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Domain-Id: default Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Domain-Name: Default Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Project-Name: admin Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Role: reader,member,admin Oct 30 01:02:39.022484 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Roles: reader,member,admin Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6345a90487264af499b3342614a87ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6345a90487264af499b3342614a87ec3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6345a90487264af499b3342614a87ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant: admin Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant-Id: 6345a90487264af499b3342614a87ec3 Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-Tenant-Name: admin Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User: admin Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Domain-Id: default Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Domain-Name: Default Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Id: e23837cd4788413c9fb97c7f11ede732 Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: X-User-Name: admin Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: method: > Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: exception: Flavor 451 could not be found. Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: action_args: {'id': '451'} Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:39.024108 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:39.025058 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: ERROR nova.api.openstack.wsgi Oct 30 01:02:39.026582 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-a42d8b72-9555-4ce8-b5da-1dcf116b0427 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:39.027917 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-a42d8b72-9555-4ce8-b5da-1dcf116b0427 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011953 Oct 30 01:02:39.027917 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 30 01:02:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:40.238841 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:40.239884 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Oct 30 01:02:40.240275 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:40.788359 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-3919f7ec-bd56-4fa6-b3b1-421f0e31ab27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:40.869803 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-3919f7ec-bd56-4fa6-b3b1-421f0e31ab27 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.491770 Oct 30 01:02:40.870360 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 30 01:02:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:02:42.133562 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:42.134571 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 30 01:02:42.134967 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:42.663416 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-b95ff0d2-f3bb-471a-a569-bfc9d6bc8c1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:42.744695 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-b95ff0d2-f3bb-471a-a569-bfc9d6bc8c1b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.469645 Oct 30 01:02:42.745242 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 30 01:02:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:02:43.988859 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:43.989857 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 30 01:02:43.990246 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:44.524593 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-e105ca97-0897-4b8d-b1d0-67ee6548476a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:44.585608 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-e105ca97-0897-4b8d-b1d0-67ee6548476a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.458861 Oct 30 01:02:44.588479 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 30 01:02:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:02:45.826277 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:45.827343 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 30 01:02:45.827778 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:46.372122 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-e7d9cd98-28df-402b-a750-ca44cb389105 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:46.500485 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-e7d9cd98-28df-402b-a750-ca44cb389105 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.533282 Oct 30 01:02:46.501067 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Oct 30 01:02:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:02:47.760729 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:47.761747 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 30 01:02:47.762140 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:48.306391 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-55b24362-fefa-4664-b3af-ddb220b31b4b admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:48.327213 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-55b24362-fefa-4664-b3af-ddb220b31b4b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.426140 Oct 30 01:02:48.327803 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sun Oct 30 01:02:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:03:48.334363 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:48.335545 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-69ba81ea-85f2-41d5-9728-bdc892dfe7ba admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Oct 30 01:03:48.336059 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Sun Oct 30 01:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:03:48.344387 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:48.840481 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-8d01ed4e-7ea0-49cf-8db1-ac3d93c4ae4c admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:48.861835 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-8d01ed4e-7ea0-49cf-8db1-ac3d93c4ae4c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.518876 Oct 30 01:03:48.862397 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Oct 30 01:03:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:03:48.885108 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_api:SELECT=14 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:48.888854 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-cc4319b2-2195-4d25-8886-dd0089a795f9 admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:48.896567 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-cc4319b2-2195-4d25-8886-dd0089a795f9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012843 Oct 30 01:03:48.899512 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sun Oct 30 01:03:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:03:48.919859 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-bf70a570-812f-45ce-a195-ede9d6e1a1db admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:48.932773 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-bf70a570-812f-45ce-a195-ede9d6e1a1db admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020046 Oct 30 01:03:48.933771 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sun Oct 30 01:03:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:48.949158 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:48.956953 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011763 Oct 30 01:03:48.957480 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sun Oct 30 01:03:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:03:48.970097 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-8e6fe046-16e7-40e6-abcb-df11ffcf0d68 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:48.977804 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-8e6fe046-16e7-40e6-abcb-df11ffcf0d68 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011770 Oct 30 01:03:48.978361 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sun Oct 30 01:03:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:05.180129 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:05.181179 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 30 01:07:05.181614 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:05.325590 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_api:SELECT=6 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:05.495944 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:05.501564 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:05.502036 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:05.502467 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:05.503418 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:05.503889 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:05.504301 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:05.536643 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-a132d8e5-69eb-4faa-b111-2621533de124 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.212234 Oct 30 01:07:05.537209 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 30 01:07:05 2022] GET /compute/v2.1/os-services => generated 785 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:07:06.649917 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:06.650967 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 30 01:07:06.651368 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:06.843604 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:06.847013 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:06.847494 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:06.847955 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:06.848679 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:06.849130 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:06.849551 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:06.873342 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-b80e25f4-916a-437c-a4f0-4eaa05ef9541 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.080458 Oct 30 01:07:06.873937 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 30 01:07:06 2022] GET /compute/v2.1/os-services => generated 785 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:07:18.360438 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:18.361436 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 30 01:07:18.361826 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:18.505675 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_cell0:SELECT=4 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:18.506844 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_cell1:SELECT=4 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:18.507469 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG dbcounter [-] [104440] Writing DB stats nova_api:SELECT=8 {{(pid=104440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:18.557676 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:18.561174 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:18.561799 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:18.562239 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:18.563073 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:18.563417 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:18.563865 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:18.589149 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-1540de67-2195-4d0d-aa1d-136fc755d257 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.088343 Oct 30 01:07:18.589724 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 30 01:07:18 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:07:19.674547 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG nova.api.openstack.wsgi [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] Calling method '>' {{(pid=104441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:19.675575 dv-cinder-master-3-smb devstack@n-api.service[104441]: INFO nova.api.openstack.requestlog [None req-389f477d-c681-49c5-9969-6c806e43fc1f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 30 01:07:19.676041 dv-cinder-master-3-smb devstack@n-api.service[104441]: [pid: 104441|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Oct 30 01:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:19.868702 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG nova.api.openstack.wsgi [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] Calling method '>' {{(pid=104440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:19.872095 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:19.872646 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:19.873068 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:19.873768 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:19.874205 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:19.874616 dv-cinder-master-3-smb devstack@n-api.service[104440]: DEBUG oslo_concurrency.lockutils [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:19.898194 dv-cinder-master-3-smb devstack@n-api.service[104440]: INFO nova.api.openstack.requestlog [None req-92a682b6-a4e3-4446-b793-8ac53d0a0310 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.082158 Oct 30 01:07:19.898753 dv-cinder-master-3-smb devstack@n-api.service[104440]: [pid: 104440|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Oct 30 01:07:19 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:08:20.481883 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 30 01:08:20.492856 dv-cinder-master-3-smb devstack@n-api.service[104439]: Sun Oct 30 01:08:20 2022 - graceful shutdown triggered... Oct 30 01:08:20.493579 dv-cinder-master-3-smb devstack@n-api.service[104440]: Gracefully killing worker 1 (pid: 104440)... Oct 30 01:08:20.494050 dv-cinder-master-3-smb devstack@n-api.service[104441]: Gracefully killing worker 2 (pid: 104441)... Oct 30 01:08:20.610551 dv-cinder-master-3-smb devstack@n-api.service[104441]: DEBUG dbcounter [-] [104441] Writing DB stats nova_api:SELECT=4 {{(pid=104441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:21.484364 dv-cinder-master-3-smb devstack@n-api.service[104439]: worker 1 buried after 1 seconds Oct 30 01:08:21.484364 dv-cinder-master-3-smb devstack@n-api.service[104439]: worker 2 buried after 1 seconds Oct 30 01:08:21.484712 dv-cinder-master-3-smb devstack@n-api.service[104439]: goodbye to uWSGI. Oct 30 01:08:21.486008 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 30 01:08:21.486793 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 30 01:08:21.491128 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 30 01:08:21.500506 dv-cinder-master-3-smb devstack@n-api.service[119504]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 01:08:21 2022] *** Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: nodename: dv-cinder-master-3-smb Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: machine: x86_64 Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: clock source: unix Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: pcre jit disabled Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: detected number of CPU cores: 4 Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: current working directory: / Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: detected binary path: /usr/bin/uwsgi-core Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: your processes number limit is 47680 Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: your memory page size is 4096 bytes Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: detected max file descriptor number: 2048 Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: lock engine: pthread robust mutexes Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: thunder lock: enabled Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 30 01:08:21.506071 dv-cinder-master-3-smb devstack@n-api.service[119504]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 01:08:21.544997 dv-cinder-master-3-smb devstack@n-api.service[119504]: Python main interpreter initialized at 0x5608d50199c0 Oct 30 01:08:21.544997 dv-cinder-master-3-smb devstack@n-api.service[119504]: python threads support enabled Oct 30 01:08:21.544997 dv-cinder-master-3-smb devstack@n-api.service[119504]: your server socket listen backlog is limited to 100 connections Oct 30 01:08:21.544997 dv-cinder-master-3-smb devstack@n-api.service[119504]: your mercy for graceful operations on workers is 90 seconds Oct 30 01:08:21.545470 dv-cinder-master-3-smb devstack@n-api.service[119504]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 01:08:21.545470 dv-cinder-master-3-smb devstack@n-api.service[119504]: *** Operational MODE: preforking *** Oct 30 01:08:21.545736 dv-cinder-master-3-smb devstack@n-api.service[119504]: *** uWSGI is running in multiple interpreter mode *** Oct 30 01:08:21.545736 dv-cinder-master-3-smb devstack@n-api.service[119504]: spawned uWSGI master process (pid: 119504) Oct 30 01:08:21.545946 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 30 01:08:21.556612 dv-cinder-master-3-smb devstack@n-api.service[119504]: spawned uWSGI worker 1 (pid: 119523, cores: 1) Oct 30 01:08:21.556612 dv-cinder-master-3-smb devstack@n-api.service[119504]: spawned uWSGI worker 2 (pid: 119524, cores: 1) Oct 30 01:08:21.556612 dv-cinder-master-3-smb devstack@n-api.service[119504]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 01:08:22.214922 dv-cinder-master-3-smb devstack@n-api.service[119524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:08:22.217956 dv-cinder-master-3-smb devstack@n-api.service[119523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:08:23.471399 dv-cinder-master-3-smb devstack@n-api.service[119523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:08:23.471399 dv-cinder-master-3-smb devstack@n-api.service[119523]: from cryptography.utils import int_from_bytes Oct 30 01:08:23.472171 dv-cinder-master-3-smb devstack@n-api.service[119523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:08:23.472171 dv-cinder-master-3-smb devstack@n-api.service[119523]: from cryptography.utils import int_from_bytes Oct 30 01:08:23.472344 dv-cinder-master-3-smb devstack@n-api.service[119524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:08:23.472344 dv-cinder-master-3-smb devstack@n-api.service[119524]: from cryptography.utils import int_from_bytes Oct 30 01:08:23.472344 dv-cinder-master-3-smb devstack@n-api.service[119524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:08:23.472344 dv-cinder-master-3-smb devstack@n-api.service[119524]: from cryptography.utils import int_from_bytes Oct 30 01:08:26.159823 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:08:26.160496 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:08:26.160843 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:08:26.160934 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:08:26.161223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:08:26.161326 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:08:26.161686 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:08:26.161807 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:08:26.162104 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:08:26.162218 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:08:26.162717 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.162832 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.163253 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.163410 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.163809 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.163933 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.164336 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.164443 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.164873 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.165266 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.165454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.165561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.165932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.166045 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.166461 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.166570 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.167551 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.167715 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.168012 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.168126 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.168546 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.168650 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.169089 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.169193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.169625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.169728 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.170238 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.170349 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.170652 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.170743 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.171184 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.171284 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.171724 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.171835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.172266 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.172368 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.172779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.172904 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.173631 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.173751 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.174862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.174983 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.175068 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.175146 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.175319 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.175422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.175904 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.176031 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.176436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.176543 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.176955 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.177060 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.177492 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.177602 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.178013 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.178150 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.178555 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.178675 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.179081 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.179200 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.179770 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.179881 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.180303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.180404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.180833 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.180937 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.181359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.181502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.182057 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.182160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.183143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.183249 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.183799 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.184392 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.184508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.185412 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.186047 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.186239 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.186392 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.186549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.186743 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.186881 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.187020 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.187162 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.187331 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.187491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.187741 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.187885 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.188045 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.188184 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.188304 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.188427 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.188611 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.188767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.188985 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.189134 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.189309 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.189465 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.189604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.189781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.189922 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.190135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.190466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.190633 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.190775 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.191044 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.191200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.191338 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.191475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.192027 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.192187 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.192313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.192457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.192457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.192814 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.192941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.193110 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.193245 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.193369 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.193503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.193636 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.193761 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.193894 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194027 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194153 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194564 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194692 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194829 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.194963 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.195109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.195245 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.195372 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.195497 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.196171 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.196432 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.196673 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.196925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.197153 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.197383 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.197606 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.197845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.198074 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.198325 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.198904 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.199150 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.199394 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.199692 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.199851 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.199993 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.200125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.200276 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.200418 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.200565 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.200705 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.200843 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.200985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.201118 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.201277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.201425 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.201565 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.201693 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.201823 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202117 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202422 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202679 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202818 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.202948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.203208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.203345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.203473 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.203637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.203771 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.203933 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.204101 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.204232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.204373 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.204514 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.204645 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.204804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.204948 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.205104 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.205234 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.205364 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.205515 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.205666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.205798 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.205940 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206617 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206747 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206747 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.206747 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.207128 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.207258 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.207419 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.207607 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.207758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.207926 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.208120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.208260 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.208392 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.208541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.209599 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.209764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.209764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.209764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.210213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.210389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.210389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.210389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.210798 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.210925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.211073 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.211246 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.211388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.211528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.211754 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.211896 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.211896 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.212421 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.212560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.212703 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.212850 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.212850 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.213106 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.213240 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.213381 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214027 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214170 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214448 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214575 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214711 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214855 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.214996 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.215123 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.215261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.215397 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.215530 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.215710 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.215840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.215969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.216106 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.216234 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.216379 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.216509 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.216637 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.216779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.216912 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.217052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.217052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.217323 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.217452 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.217581 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.217581 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.217819 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.217957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.218095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.218223 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.218350 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.218477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.218604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.218754 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.218928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.219073 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.219212 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.219357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.219516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.219921 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.220059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.220217 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.220367 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.220523 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.220672 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.220812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.220943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.221076 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.221213 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.221349 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.221496 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.221636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:08:26.221769 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.221901 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.222032 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.222184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.222410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.222551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.222683 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.222816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.222959 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.223104 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.223245 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.223388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.223518 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.223688 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.223841 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.223989 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.224131 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.224262 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.224405 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.224545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.224685 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.224827 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.224969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.225109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.225109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.225366 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.225498 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.225647 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.225791 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.225922 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.226055 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.226186 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.226317 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.226449 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.226599 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.226729 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.226877 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.227010 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.227142 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.227286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.227416 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.227549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.227752 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.227897 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.228029 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.228172 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.228316 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.228460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.228600 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.228730 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.228862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.229006 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.229207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.230086 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.230086 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.230366 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.230512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.230512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.230934 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.231261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.231607 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.231871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.232121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.232359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.232359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.232803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.232803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.233254 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.233624 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.233861 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.233861 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.234315 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.234551 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.234800 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.235060 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.235291 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.235532 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.235816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.236059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.236306 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.236557 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.236805 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.237041 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.237283 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.237571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.237728 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.237863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.237996 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.238139 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.238283 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.238423 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.238568 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.238709 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.238840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.238840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.239100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.239288 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.239502 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.239657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.239814 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.239947 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.240359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.240519 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.240674 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.240811 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.240941 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.241080 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.241224 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.241369 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.241534 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.241724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.241855 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242131 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242131 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242131 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242131 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242131 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242780 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.242920 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.243069 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.243201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.243343 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.243484 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.243664 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.243811 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.243957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.244089 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.244229 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.244362 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.244502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.244635 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.244780 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.244912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.245051 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.245192 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.245326 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.245471 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.245611 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.245768 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.245930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.246065 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.246209 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.246366 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.246508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.246647 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.246779 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.246918 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.247050 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.247204 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.247344 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.247488 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.247645 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.247804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.247936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.248081 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.248213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.248352 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.248484 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.248626 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.248776 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.248917 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.249065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.249209 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.249341 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.249487 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.249792 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.249929 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.250064 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.250195 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.250587 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.250738 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.250952 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.251101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.251239 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.251386 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.251531 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.251974 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.252129 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.252270 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.252404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.252546 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.252678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.252827 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.252996 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.253139 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.253270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.253411 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.253562 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.253712 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.253862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.254102 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.254279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.254466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.254658 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.254860 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.255040 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.255223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.255399 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.255579 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.255783 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.255988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.256172 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.256363 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.256541 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.256731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.256924 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.257104 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.257281 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.257281 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.257281 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.257778 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.257968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.258147 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.258334 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.258507 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.258678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.258869 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.259071 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.259253 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.259436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.259645 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.259824 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.260002 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.260224 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.260404 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.260835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.260982 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.261120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.261120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.261495 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.261667 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.261801 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.261938 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262082 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262227 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.262370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.263359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.263359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.263359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.263359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.263956 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.264096 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.264314 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.264651 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.264966 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.265282 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.265612 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.265928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.266242 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.266556 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.266864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.267174 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.267485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.267828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.268141 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.268455 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.268763 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.269078 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.269387 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.269693 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.269998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.270314 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.270683 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.271035 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.271259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.271628 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.271851 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.272053 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.272257 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.272517 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.272735 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.272940 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.273131 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.273339 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.273535 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.273736 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.273941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.274148 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.274352 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.274569 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.274779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.274979 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.275185 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.275377 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.275566 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.275817 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.276514 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.276704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.276897 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.277089 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.277282 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.277504 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.277696 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.277928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.278156 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.278350 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.278556 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.278763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.278969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.279161 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.279362 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.279555 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.279929 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.280122 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.280324 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.280544 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.280767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.281322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.281537 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.281746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.281970 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.282179 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.282386 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.282610 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.282844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.283087 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.283303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.283516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.283777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.284017 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.284230 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.284443 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.284684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.284916 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.285138 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.285360 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.285567 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.285793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.286014 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.286243 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.286453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.286662 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.286874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.287079 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.287303 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.287517 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.287773 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.287971 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.288176 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.288405 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.288730 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.288950 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.289159 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.289381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.289603 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.289818 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.290043 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.290043 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.290437 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.290657 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.290864 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.291090 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.292295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.292295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.292740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.292958 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.293170 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.293170 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.293600 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.293808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.294040 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.294040 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.294435 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.294661 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.294872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.294872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.295262 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.295472 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.295712 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.295943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.296154 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.296393 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.296604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.296828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.297052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.297260 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.297483 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.297707 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.297926 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.298132 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.298363 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.298571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.298777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.298985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.299205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.299429 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.299711 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.299930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.300140 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.300362 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.300568 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.300777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.301003 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.301232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.301811 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.301811 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.302219 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.302442 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.302662 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.302662 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.303213 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.303438 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.303682 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.303682 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.304100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.304311 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.304524 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.304524 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.304919 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.305141 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.305364 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.305364 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.305771 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.305978 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.305978 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.306412 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.306629 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.306849 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.306849 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.307204 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.307536 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.307788 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.307998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.308206 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.308414 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.308621 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.308844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.309066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.309285 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.309495 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.309706 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.309916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.310141 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.310352 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.310577 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.310783 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.310990 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.311199 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.311423 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.311814 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.312116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.312456 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.312683 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.312904 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.312904 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.313314 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.313531 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.313739 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.313948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.314174 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.314390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.314600 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.314810 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.315019 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.315264 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.315487 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.315745 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.315958 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.316177 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.316389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.316598 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.316832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.317049 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.317259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.317469 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.317737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.317964 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.318188 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.318410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.318643 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.318854 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.319066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.319285 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.319561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.319819 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.320032 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.320252 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.320459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.320692 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.320906 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.321111 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.321386 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.321598 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.321835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.322176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.322502 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.322865 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.323080 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.323293 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.323293 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.323787 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.323995 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.324207 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.324529 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.324757 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.325046 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.325258 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.325475 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.325684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.325894 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.326111 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.326338 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.326561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.326771 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.327049 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.327270 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.327481 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.327733 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.327951 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.328175 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.328393 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.329355 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.329355 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.329777 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.329989 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.329989 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.329989 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.330621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.330851 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.331061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.331061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.331484 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.331727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.331727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.331727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.333194 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.333413 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.333645 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.333645 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.333645 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.333645 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.334461 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.334676 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.334676 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.335072 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.335306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.335306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.335306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.335949 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.336178 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.336178 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.336178 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.336796 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.337008 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.337008 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.337008 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.337617 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.337832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.337832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.337832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.338423 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.339176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.339176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.339176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.339820 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.340033 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.340033 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.340453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.340685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.340910 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.340910 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.341328 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.341549 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.341761 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.341761 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.342183 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.342377 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.342605 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.343087 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.343564 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.343564 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.343564 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.344300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.344512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.344512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.344512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.345169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.345390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.345390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.345781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.345998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.345998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.345998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.346747 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.346747 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.347153 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.347374 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.347625 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.347625 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.348041 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.348265 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.348265 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.348682 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.348891 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.349100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.349100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.349507 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.349728 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.349946 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.350160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.350375 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.350700 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.350911 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.351139 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.351139 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.351565 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.351814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.352136 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.352136 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.352533 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.352740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.353240 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.353472 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.353472 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.354029 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.354029 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.355001 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.355225 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.355225 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.355674 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.355884 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.356095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.356095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.356501 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.356725 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.356951 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.356951 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.357365 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.357586 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.357586 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.357995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.358206 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.358419 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.358419 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.358812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.359025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.359025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.359442 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.359735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.359960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.359960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.360358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.360588 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.360811 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.361033 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.361259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.361478 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.361720 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.362036 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.362369 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.362684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.362999 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.363452 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.363718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.364084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.364311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.364311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.364722 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.364933 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.365160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.365160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.365555 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.365781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.365781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.366205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.366439 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.366652 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.366862 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.367092 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.368135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.368367 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.368367 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.368767 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.368978 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.368978 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.369391 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.369617 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.369617 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.369617 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.370249 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.370461 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.370461 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.370461 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.371078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.371303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.371303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.371303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.371965 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.372201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.372201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.372624 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.372832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.372832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.372832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.373661 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.373880 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.374119 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.374119 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.374119 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.374849 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.375111 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.375322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.375322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.375848 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.376092 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.376092 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.376496 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.376976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.376976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.376976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.377617 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.377829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.377829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.377829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.378450 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.378663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.378663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.379067 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.379276 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.379500 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.379500 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.379944 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.380149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.380372 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.380594 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.380803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.381034 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.381249 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.381471 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.381677 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.381888 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.382114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.382334 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.382543 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.382754 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.382963 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.383236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.383789 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.384033 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.384243 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.384243 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.384797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.384797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.385323 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.385577 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.385577 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.385994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.386217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.386217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.386639 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.386847 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.387063 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.387063 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.387473 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.387701 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.387701 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.388142 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.388353 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.388583 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.388583 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.388991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.389201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.389413 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.389413 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.389831 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.390042 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.390271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.390271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.390682 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.390891 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.391101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.391101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.391519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.391772 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.392004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.392217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.392434 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.392646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.392646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.393058 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.393267 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.393526 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.393899 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.393899 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.394497 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.395062 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.395403 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.395754 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.395969 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.396203 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.396417 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.396625 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.396833 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.397037 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.397245 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.397467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.397686 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.397686 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.398074 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.398294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.398509 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.398725 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.398725 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.399108 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.399315 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.399525 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.399815 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.399815 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.400215 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.400421 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.400642 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.400853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.401607 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.401817 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.401817 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.402279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.402491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.402701 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.402923 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.403144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.403354 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.403354 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.403837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.404170 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.404469 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.404690 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.404690 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.405070 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.405290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.405510 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.405717 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.405717 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.406132 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.406348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.406572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.406777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.406777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.407175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.407380 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.407655 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.407863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.407863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.408276 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.408489 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.408710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.408917 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.409143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.409344 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.409546 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.409756 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.409756 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.410222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.410467 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.410677 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.410896 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.411107 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.411326 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.411326 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.411790 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.412002 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.412214 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.412424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.412654 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.412881 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.412881 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.413300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.413512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.413722 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.413933 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.414180 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.414507 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.414818 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.415057 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.415057 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.415467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.415741 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.415963 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.416185 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.416396 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.416630 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.416630 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.417574 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.417787 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.418009 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.418229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.418229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.418657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.418874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.419096 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.419317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.419532 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.419785 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.420026 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.420237 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.420237 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.420610 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.420804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.420804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.421214 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.421442 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.421654 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.421873 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.421873 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.422285 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.422509 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.422724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.422943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.422943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.423345 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.423565 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.423806 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.424021 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.424238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.424468 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.424468 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.425085 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.425302 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.425500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.425694 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.425899 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.426107 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.426107 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.426492 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.426692 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.426893 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.427101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.427323 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.427698 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.427698 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.428086 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.428299 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.428509 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.428737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.428737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.429165 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.429361 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.429551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.429742 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.429951 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.430166 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.430166 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.430554 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.430765 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.433181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.434410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.434625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.434960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.435297 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.435523 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.435523 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.435944 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.436163 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.436163 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.436547 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.436767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.436969 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.437176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.437386 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.437599 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.437599 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.438002 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.438200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.438412 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.438611 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.438808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.439030 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.439030 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.439460 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.439680 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.439869 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.440056 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.448097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.448311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.448311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.448595 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.448732 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.448880 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.449024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.449024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.449300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.449433 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.449573 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.449716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.449859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450021 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.450803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.451174 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.451314 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.451454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.451701 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.451840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.451990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452142 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452285 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452285 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452842 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.452985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.454084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.455121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.456646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.457802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.458859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.459890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.460873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.460873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.460873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.460873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.462749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.462749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.462749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.462749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.462749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.462749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.464098 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.464265 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.464805 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.465183 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.465845 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.466908 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.466908 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.466908 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.467169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.467456 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.467803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.470874 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.471057 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.471558 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.471724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.472021 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.472353 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.472692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.473014 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.473513 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.473840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.474447 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.474447 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.474767 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.475098 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.475413 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.475763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.476368 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.476538 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.476861 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.481981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.482616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.483155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.483530 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.483745 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.484054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.484374 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.484688 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.485005 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.485320 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.485632 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.485945 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.486252 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.486636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.486916 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.487341 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.487791 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.488031 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.488362 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.488682 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.488998 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.489313 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.489673 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.489988 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.490296 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.490936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.490936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.491250 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.491515 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.491853 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.493201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.493201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.493201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.493201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.493837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.493837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.494249 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.494422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.494756 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.495072 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.495384 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.495722 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.496321 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.496583 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.496920 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.497266 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.497565 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500821 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500821 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.500991 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.501265 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO dbcounter [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Registered counter for database nova_api Oct 30 01:08:26.501452 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.501879 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.502498 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.502786 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.503103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.503428 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.503848 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.505043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.505043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.505043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.505043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.505403 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.505663 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.505975 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.506274 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.506565 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.506873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.507181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.507481 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.507814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.508503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.508503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.508831 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.509023 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.509325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.509634 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.509936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.510238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.510569 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.510872 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.511184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.511487 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.511829 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.512131 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.512439 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.512795 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.513103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.513405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.513732 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.514034 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.514347 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.514649 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.514956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.515275 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.515663 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.515915 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.516260 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.516570 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.517115 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.517644 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.518144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.518726 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.518830 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.519114 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.519628 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.520274 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.521961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.521961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.521961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.521961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.521961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.521961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.522465 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.522550 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.522837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.523336 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.523703 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.523981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.524293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.524719 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.524939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.524939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.525293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.525522 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.525841 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.526700 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.527019 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.528001 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.528315 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.528632 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.528946 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.529476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.530005 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.530338 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.530650 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.530960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.531478 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.531727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.532049 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.532366 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.532675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.532994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.533160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writer thread running {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:26.533313 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.533616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.533928 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.534235 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.534564 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.535357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.535357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.536550 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.536550 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.536550 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.536550 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.536911 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.537012 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.537325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.537620 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.537996 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.538223 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.538524 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.538833 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.539315 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.539470 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.539739 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.540043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.540668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.540668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.540980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.541224 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.541510 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.542439 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.542685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.542968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.543270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.543570 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.543894 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.544221 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.544551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.545061 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.545225 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.545480 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.546195 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.546195 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.546389 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.546705 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.547024 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.547332 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.549459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.549459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.549459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.549459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.549459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.550063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.550063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.550294 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.550503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.551363 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.551363 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.551769 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.551769 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.552058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.552509 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.552684 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.553031 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.553290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.553589 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.553895 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.554202 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.554513 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.554827 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.555127 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.555438 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.555894 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.556163 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.556430 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559809 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559809 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:08:26.559809 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:08:26.593415 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.context [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),981e4b1c-a815-41e8-a403-49a91c7c17f9(cell1) {{(pid=119524) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:08:26.597457 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:26.597938 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:26.599568 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:26.600415 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:26.608794 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:26.608794 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:26.608794 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO dbcounter [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Registered counter for database nova_cell0 Oct 30 01:08:26.609313 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO dbcounter [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Registered counter for database nova_cell1 Oct 30 01:08:26.619049 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.619876 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.622713 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO dbcounter [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Registered counter for database nova_api Oct 30 01:08:26.626400 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writer thread running {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:26.628366 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writer thread running {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:26.644157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.652705 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writer thread running {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:26.711042 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.context [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),981e4b1c-a815-41e8-a403-49a91c7c17f9(cell1) {{(pid=119523) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:08:26.716119 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:26.716812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:26.718400 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:26.719387 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:26.720252 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:26.722521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:26.724979 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO dbcounter [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Registered counter for database nova_cell0 Oct 30 01:08:26.729385 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO dbcounter [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Registered counter for database nova_cell1 Oct 30 01:08:26.737302 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.739286 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.748359 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writer thread running {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:26.751049 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writer thread running {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:26.785517 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO dbcounter [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Registered counter for database nova_cell0 Oct 30 01:08:26.793205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.800064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writer thread running {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:26.907505 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO dbcounter [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Registered counter for database nova_cell0 Oct 30 01:08:26.917420 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:08:26.924396 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writer thread running {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:08:27.123472 dv-cinder-master-3-smb devstack@n-api.service[119524]: WARNING keystonemiddleware.auth_token [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:08:27.131055 dv-cinder-master-3-smb devstack@n-api.service[119524]: WARNING keystonemiddleware.auth_token [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:08:27.250931 dv-cinder-master-3-smb devstack@n-api.service[119523]: WARNING keystonemiddleware.auth_token [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:08:27.258947 dv-cinder-master-3-smb devstack@n-api.service[119523]: WARNING keystonemiddleware.auth_token [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:08:27.468054 dv-cinder-master-3-smb devstack@n-api.service[119524]: WARNING keystonemiddleware.auth_token [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:08:27.474537 dv-cinder-master-3-smb devstack@n-api.service[119524]: WARNING keystonemiddleware.auth_token [None req-d4ba9d5f-e117-4093-8ddb-65f41f712854 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:08:27.480716 dv-cinder-master-3-smb devstack@n-api.service[119524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608d50199c0 pid: 119524 (default app) Oct 30 01:08:27.598007 dv-cinder-master-3-smb devstack@n-api.service[119523]: WARNING keystonemiddleware.auth_token [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:08:27.604591 dv-cinder-master-3-smb devstack@n-api.service[119523]: WARNING keystonemiddleware.auth_token [None req-3b3ef25a-a265-4fea-883e-85571f69207e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:08:27.609899 dv-cinder-master-3-smb devstack@n-api.service[119523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608d50199c0 pid: 119523 (default app) Oct 30 01:09:04.648691 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:04.649498 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:04.650215 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:04.650931 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:06.053594 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e872a1e1-e112-4e1e-b401-d36932babd4b tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Action: 'create', calling method: .version_select at 0x7f048cfdd940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-484917866", "metadata": {"Type": "work"}}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:07.993090 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e872a1e1-e112-4e1e-b401-d36932babd4b tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.366155 Oct 30 01:09:07.994053 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 30 01:09:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3369 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 30 01:09:08.013255 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=3 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:08.015821 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=3 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:08.022251 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=3 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:08.023499 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=3 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:08.104446 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0dac6520-e08a-488f-8bbc-2ef88121becf tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048ce2be50>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:08.354671 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9db82b9a-a6b1-4165-917a-8c29bf1bd657 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Calling method '.version_select at 0x7f048cfa29d0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:08.361122 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0dac6520-e08a-488f-8bbc-2ef88121becf tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d9160491-5271-476b-bb3d-b70110d6dc67" status: 200 len: 349 microversion: 2.1 time: 0.263755 Oct 30 01:09:08.361707 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 2/2] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:08 2022] GET /compute/v2.1/os-volumes/d9160491-5271-476b-bb3d-b70110d6dc67 => generated 349 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:09.443487 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9db82b9a-a6b1-4165-917a-8c29bf1bd657 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728" status: 200 len: 353 microversion: 2.1 time: 1.437321 Oct 30 01:09:09.452957 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:08 2022] GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728 => generated 353 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:09.463889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6cc63a2a-a06c-43a5-a3b4-66afaf67914b tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Calling method '.version_select at 0x7f048cdc15e0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:09.773477 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6cc63a2a-a06c-43a5-a3b4-66afaf67914b tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728" status: 200 len: 353 microversion: 2.1 time: 0.272768 Oct 30 01:09:09.773477 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:09 2022] GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728 => generated 353 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:09.775610 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d46b1323-c207-45fb-86f7-56fb1646f000 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Calling method '.version_select at 0x7f048ce69ee0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:10.143729 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d46b1323-c207-45fb-86f7-56fb1646f000 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728" status: 202 len: 0 microversion: 2.1 time: 0.403761 Oct 30 01:09:10.144615 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 2/5] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:09:09 2022] DELETE /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:09:10.151768 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9ab63c1d-ffd9-4f8b-911c-df0823c4ff7e tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Calling method '.version_select at 0x7f048cdc1ca0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:10.281747 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9ab63c1d-ffd9-4f8b-911c-df0823c4ff7e tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728" status: 200 len: 352 microversion: 2.1 time: 0.133749 Oct 30 01:09:10.283046 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 4/6] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:10 2022] GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:10.621325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-57637b9a-8730-493c-bafa-1a8f0f687f40 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048ce2a430>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:10.776561 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-57637b9a-8730-493c-bafa-1a8f0f687f40 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bb0c068b-1625-4d9d-ae3b-6bd0cc739eef" status: 200 len: 350 microversion: 2.1 time: 0.146922 Oct 30 01:09:10.776561 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:10 2022] GET /compute/v2.1/os-volumes/bb0c068b-1625-4d9d-ae3b-6bd0cc739eef => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:11.300231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c30abeaf-f93a-427a-aaf1-eeec2262d0e0 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Calling method '.version_select at 0x7f048cdc1b80>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:11.692829 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-c30abeaf-f93a-427a-aaf1-eeec2262d0e0 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] HTTP exception thrown: Volume cce12491-8230-4853-8ede-c86a4bc19728 could not be found. Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c30abeaf-f93a-427a-aaf1-eeec2262d0e0 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Request method failure captured: Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728 HTTP/1.1 Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc6wXaZ-T3SW62wFfYuj_o7Wkj-YgQxrtGP0WU1ghQsKkO14yDFo0w8Qvf49ls5Z4MvJtpYgwNtBLVvTpAf2wKwxnaJK3P5WEkvUIjBk2c5j9ewJjAdpiErxXCK2NOPYFrmru8OJTT-_PVdeEFU_HalYK-e7IpbVFnNTkU1YgxJb1Sk Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 422b0059789549cea55b9bcdad68680f Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesGetTestJSON-742854610 Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:09:11.706429 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/422b0059789549cea55b9bcdad68680f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_422b0059789549cea55b9bcdad68680f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/422b0059789549cea55b9bcdad68680f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/422b0059789549cea55b9bcdad68680f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesGetTestJSON-742854610 Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 422b0059789549cea55b9bcdad68680f Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesGetTestJSON-742854610 Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesGetTestJSON-742854610-project Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: fa75a17c73cf472ba19d73ac24b9ef7f Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesGetTestJSON-742854610-project Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Volume cce12491-8230-4853-8ede-c86a4bc19728 could not be found. Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'cce12491-8230-4853-8ede-c86a4bc19728'} Oct 30 01:09:11.711147 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cce12491-8230-4853-8ede-c86a4bc19728 could not be found. (HTTP 404) (Request-ID: req-4df547d0-d844-4d80-8fae-703c5a7a3b54) Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:11.714238 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:09:11.716495 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cce12491-8230-4853-8ede-c86a4bc19728 could not be found. Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:09:11.718523 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cce12491-8230-4853-8ede-c86a4bc19728 could not be found. Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cce12491-8230-4853-8ede-c86a4bc19728 could not be found. Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c30abeaf-f93a-427a-aaf1-eeec2262d0e0 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] Returning 404 to user: Volume cce12491-8230-4853-8ede-c86a4bc19728 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c30abeaf-f93a-427a-aaf1-eeec2262d0e0 tempest-VolumesGetTestJSON-742854610 tempest-VolumesGetTestJSON-742854610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728" status: 404 len: 109 microversion: 2.1 time: 0.415116 Oct 30 01:09:11.720038 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:11 2022] GET /compute/v2.1/os-volumes/cce12491-8230-4853-8ede-c86a4bc19728 => generated 109 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:09:12.958651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7228b1a-4024-40c5-b31b-92f66e77b21f tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048ce69ee0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:13.079959 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f7228b1a-4024-40c5-b31b-92f66e77b21f tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/02c09a60-e8d2-41ce-bd3b-32c9fe2c8ef2" status: 200 len: 350 microversion: 2.1 time: 0.125370 Oct 30 01:09:13.080522 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 4/9] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:12 2022] GET /compute/v2.1/os-volumes/02c09a60-e8d2-41ce-bd3b-32c9fe2c8ef2 => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:13.099427 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5a35ad24-2f09-497d-9220-9e3081acbbd1 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048d7b1430>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:13.347043 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5a35ad24-2f09-497d-9220-9e3081acbbd1 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.255127 Oct 30 01:09:13.347632 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 6/10] 10.222.0.26 () {58 vars in 1134 bytes} [Sun Oct 30 01:09:13 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:13.364946 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a1871161-c509-47e8-a963-1e6bfb4ec18e tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048ce2a670>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:13.666247 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a1871161-c509-47e8-a963-1e6bfb4ec18e tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.305585 Oct 30 01:09:13.667280 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 5/11] 10.222.0.26 () {58 vars in 1149 bytes} [Sun Oct 30 01:09:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:13.686318 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-59358dee-3663-41ce-ae21-637572fec4d7 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048cdad280>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:13.934222 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-59358dee-3663-41ce-ae21-637572fec4d7 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.255337 Oct 30 01:09:13.935054 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1134 bytes} [Sun Oct 30 01:09:13 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:13.963931 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4e3efba7-b223-4981-a5f1-474411ee454b tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048ce69d30>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:14.140560 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4e3efba7-b223-4981-a5f1-474411ee454b tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.181933 Oct 30 01:09:14.144811 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 6/13] 10.222.0.26 () {58 vars in 1167 bytes} [Sun Oct 30 01:09:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:14.170524 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2389fca2-c88d-4ae5-80ae-931e2dc88e62 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048cdab5e0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:14.338376 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2389fca2-c88d-4ae5-80ae-931e2dc88e62 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.172835 Oct 30 01:09:14.339250 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 8/14] 10.222.0.26 () {58 vars in 1170 bytes} [Sun Oct 30 01:09:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:14.362704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-32aa910d-8727-4112-bf2c-ed84af56ddb9 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048cdc40d0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:14.612936 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-32aa910d-8727-4112-bf2c-ed84af56ddb9 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.255078 Oct 30 01:09:14.613591 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 7/15] 10.222.0.26 () {58 vars in 1155 bytes} [Sun Oct 30 01:09:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:14.646203 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5084611d-b2e0-4420-b129-e3dcd381c4db tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048cdab790>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:14.961889 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5084611d-b2e0-4420-b129-e3dcd381c4db tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.302778 Oct 30 01:09:14.961889 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1188 bytes} [Sun Oct 30 01:09:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:14.964113 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bec8b0a1-c8a8-4627-854b-48944a90d2c3 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] Calling method '.version_select at 0x7f048cdc49d0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:15.149302 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bec8b0a1-c8a8-4627-854b-48944a90d2c3 tempest-VolumesTestJSON-1312619415 tempest-VolumesTestJSON-1312619415-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.185205 Oct 30 01:09:15.149302 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1155 bytes} [Sun Oct 30 01:09:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:16.901326 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-55ed90e7-adc5-4b7f-b764-c6a0f072b5e2 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Action: 'create', calling method: .version_select at 0x7f048cdad5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1624175798", "metadata": {"Type": "work"}}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-55ed90e7-adc5-4b7f-b764-c6a0f072b5e2 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Request method failure captured: Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 122 Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc68wVbzjyUHurk_1kaEEvnI7dnPVg24xUDcX4SQkSSDJl9q593ufxbqGRHTPiL2iqDnQcLbwzlkRAcjA3t1_CMZG-TGHJbAMnsXAkkOgGUXEjxbpCZKwNSwK_RqVT-fqRiVJRSyp5zTHpQmeel_1CF_mNkHJCBcdBCIrSngMMNFTKI Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:09:16.916553 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: a72943f3d50a43a89118b9a80f34bccf Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1624175798", "metadata": {"Type": "work"}}} Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: Oct 30 01:09:16.918325 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1624175798', 'metadata': {'Type': 'work'}}}} Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi '#$%' Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:09:16.919314 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:09:16.921990 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:09:16.925135 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 01:09:16.925135 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.928664 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-55ed90e7-adc5-4b7f-b764-c6a0f072b5e2 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:09:16.936799 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-55ed90e7-adc5-4b7f-b764-c6a0f072b5e2 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.379084 Oct 30 01:09:16.938441 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 10/18] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 30 01:09:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 388 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:09:16.958340 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-44a92c27-698a-4e1c-a359-4bf77c22d712 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Action: 'create', calling method: .version_select at 0x7f048ce33700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2103828487", "metadata": {"Type": "work"}}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-44a92c27-698a-4e1c-a359-4bf77c22d712 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Request method failure captured: Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 120 Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc68wVbzjyUHurk_1kaEEvnI7dnPVg24xUDcX4SQkSSDJl9q593ufxbqGRHTPiL2iqDnQcLbwzlkRAcjA3t1_CMZG-TGHJbAMnsXAkkOgGUXEjxbpCZKwNSwK_RqVT-fqRiVJRSyp5zTHpQmeel_1CF_mNkHJCBcdBCIrSngMMNFTKI Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:09:16.971083 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: a72943f3d50a43a89118b9a80f34bccf Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2103828487", "metadata": {"Type": "work"}}} Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: Oct 30 01:09:16.972580 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2103828487', 'metadata': {'Type': 'work'}}}} Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi '0' Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:09:16.973367 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:09:16.974668 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:09:16.976700 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 01:09:16.976700 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:16.976700 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-44a92c27-698a-4e1c-a359-4bf77c22d712 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:09:16.978992 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-44a92c27-698a-4e1c-a359-4bf77c22d712 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026366 Oct 30 01:09:16.979264 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 9/19] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 30 01:09:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:09:17.002702 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7bae2203-0796-4c35-8eef-133e53d14fd9 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Action: 'create', calling method: .version_select at 0x7f048cd83d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1754425433", "metadata": {"Type": "work"}}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7bae2203-0796-4c35-8eef-133e53d14fd9 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Request method failure captured: Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 119 Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc68wVbzjyUHurk_1kaEEvnI7dnPVg24xUDcX4SQkSSDJl9q593ufxbqGRHTPiL2iqDnQcLbwzlkRAcjA3t1_CMZG-TGHJbAMnsXAkkOgGUXEjxbpCZKwNSwK_RqVT-fqRiVJRSyp5zTHpQmeel_1CF_mNkHJCBcdBCIrSngMMNFTKI Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:09:17.013602 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: a72943f3d50a43a89118b9a80f34bccf Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1754425433", "metadata": {"Type": "work"}}} Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: Oct 30 01:09:17.014937 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1754425433', 'metadata': {'Type': 'work'}}}} Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi '' Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:09:17.019077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:09:17.022411 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:09:17.023608 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 01:09:17.023608 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.023608 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7bae2203-0796-4c35-8eef-133e53d14fd9 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:09:17.023608 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7bae2203-0796-4c35-8eef-133e53d14fd9 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030749 Oct 30 01:09:17.028279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e95d0d3c-2a6b-4936-a305-fedf4d120109 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Calling method '.version_select at 0x7f048d7b2430>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:17.037921 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Oct 30 01:09:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:09:17.168503 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-e95d0d3c-2a6b-4936-a305-fedf4d120109 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] HTTP exception thrown: Volume tempest-invalid-944722487 could not be found. Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e95d0d3c-2a6b-4936-a305-fedf4d120109 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Request method failure captured: Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-944722487 HTTP/1.1 Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc68wVbzjyUHurk_1kaEEvnI7dnPVg24xUDcX4SQkSSDJl9q593ufxbqGRHTPiL2iqDnQcLbwzlkRAcjA3t1_CMZG-TGHJbAMnsXAkkOgGUXEjxbpCZKwNSwK_RqVT-fqRiVJRSyp5zTHpQmeel_1CF_mNkHJCBcdBCIrSngMMNFTKI Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:09:17.170606 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: a72943f3d50a43a89118b9a80f34bccf Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Volume tempest-invalid-944722487 could not be found. Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'tempest-invalid-944722487'} Oct 30 01:09:17.172226 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-944722487 could not be found. (HTTP 404) (Request-ID: req-09fd2efe-0dcf-441f-9c69-9c67288f3bc1) Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.172999 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:09:17.174178 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-944722487 could not be found. Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:09:17.175294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-944722487 could not be found. Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-944722487 could not be found. Oct 30 01:09:17.179831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.183316 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e95d0d3c-2a6b-4936-a305-fedf4d120109 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Returning 404 to user: Volume tempest-invalid-944722487 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:09:17.184305 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e95d0d3c-2a6b-4936-a305-fedf4d120109 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-944722487" status: 404 len: 98 microversion: 2.1 time: 0.160238 Oct 30 01:09:17.185152 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1215 bytes} [Sun Oct 30 01:09:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-944722487 => generated 98 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:09:17.194696 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e979751e-b443-4c41-9a4a-65ce128e4288 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003909 Oct 30 01:09:17.197516 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 12/22] 10.222.0.26 () {58 vars in 1140 bytes} [Sun Oct 30 01:09:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 01:09:17.206247 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-da9da92a-383e-4c45-a23d-d9e2294df355 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004548 Oct 30 01:09:17.211382 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1137 bytes} [Sun Oct 30 01:09:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 01:09:17.230400 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2fc68508-950f-4e4c-baa4-92c024011ccd tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Calling method '.version_select at 0x7f048cdabe50>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:17.312799 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-2fc68508-950f-4e4c-baa4-92c024011ccd tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] HTTP exception thrown: Volume 1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 could not be found. Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2fc68508-950f-4e4c-baa4-92c024011ccd tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Request method failure captured: Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: DELETE /compute/v2.1/os-volumes/1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 HTTP/1.1 Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc68wVbzjyUHurk_1kaEEvnI7dnPVg24xUDcX4SQkSSDJl9q593ufxbqGRHTPiL2iqDnQcLbwzlkRAcjA3t1_CMZG-TGHJbAMnsXAkkOgGUXEjxbpCZKwNSwK_RqVT-fqRiVJRSyp5zTHpQmeel_1CF_mNkHJCBcdBCIrSngMMNFTKI Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:09:17.315778 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: a72943f3d50a43a89118b9a80f34bccf Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Volume 1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 could not be found. Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '1a8d0147-f0c8-47b3-84b1-87c5b8b5a946'} Oct 30 01:09:17.317134 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 could not be found. (HTTP 404) (Request-ID: req-d7fb86da-0f4e-450f-a50c-b3f173530b29) Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.318158 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:09:17.324871 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 could not be found. Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 01:09:17.327807 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 could not be found. Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 could not be found. Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2fc68508-950f-4e4c-baa4-92c024011ccd tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Returning 404 to user: Volume 1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:09:17.331955 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2fc68508-950f-4e4c-baa4-92c024011ccd tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/1a8d0147-f0c8-47b3-84b1-87c5b8b5a946" status: 404 len: 109 microversion: 2.1 time: 0.104348 Oct 30 01:09:17.333733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-73cd88d5-ac19-4174-aec4-ec475bfbc0a4 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Calling method '.version_select at 0x7f048cdc4ca0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:17.333901 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:09:17 2022] DELETE /compute/v2.1/os-volumes/1a8d0147-f0c8-47b3-84b1-87c5b8b5a946 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:09:17.372726 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-73cd88d5-ac19-4174-aec4-ec475bfbc0a4 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] HTTP exception thrown: Volume c109e3da-d160-4cfa-bcdf-8e758e246168 could not be found. Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-73cd88d5-ac19-4174-aec4-ec475bfbc0a4 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Request method failure captured: Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/os-volumes/c109e3da-d160-4cfa-bcdf-8e758e246168 HTTP/1.1 Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc68wVbzjyUHurk_1kaEEvnI7dnPVg24xUDcX4SQkSSDJl9q593ufxbqGRHTPiL2iqDnQcLbwzlkRAcjA3t1_CMZG-TGHJbAMnsXAkkOgGUXEjxbpCZKwNSwK_RqVT-fqRiVJRSyp5zTHpQmeel_1CF_mNkHJCBcdBCIrSngMMNFTKI Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:09:17.375838 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b823b27bf954e1493a0f580c9edab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 9b823b27bf954e1493a0f580c9edab4f Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-VolumesNegativeTest-1568967078 Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: a72943f3d50a43a89118b9a80f34bccf Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-VolumesNegativeTest-1568967078-project Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Volume c109e3da-d160-4cfa-bcdf-8e758e246168 could not be found. Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'c109e3da-d160-4cfa-bcdf-8e758e246168'} Oct 30 01:09:17.377765 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c109e3da-d160-4cfa-bcdf-8e758e246168 could not be found. (HTTP 404) (Request-ID: req-b53ac0c8-67ff-481e-a8d5-ddf466eca812) Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.378811 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:09:17.382128 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c109e3da-d160-4cfa-bcdf-8e758e246168 could not be found. Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:09:17.385556 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c109e3da-d160-4cfa-bcdf-8e758e246168 could not be found. Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c109e3da-d160-4cfa-bcdf-8e758e246168 could not be found. Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-73cd88d5-ac19-4174-aec4-ec475bfbc0a4 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] Returning 404 to user: Volume c109e3da-d160-4cfa-bcdf-8e758e246168 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-73cd88d5-ac19-4174-aec4-ec475bfbc0a4 tempest-VolumesNegativeTest-1568967078 tempest-VolumesNegativeTest-1568967078-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c109e3da-d160-4cfa-bcdf-8e758e246168" status: 404 len: 109 microversion: 2.1 time: 0.051989 Oct 30 01:09:17.389091 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:09:17 2022] GET /compute/v2.1/os-volumes/c109e3da-d160-4cfa-bcdf-8e758e246168 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:09:19.268327 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-511763665", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:19.557018 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] validate_networks() for [('de618076-b93d-46d5-a096-a44e39256fff', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:09:23.338838 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:09:23.341467 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:09:23.343372 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:09:23.344656 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:09:23.346272 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:09:23.369777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:23.370571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:23.371198 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:23.372705 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:23.373352 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:23.374359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:23.432835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for project 95c63194a18f4768abe23f55608ec8c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:09:23.442554 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0149dc71-652d-409f-9ae2-aff8432b9b52 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'create', calling method: .version_select at 0x7f048cdc4310>, body: {"keypair": {"name": "tempest-keypair-1224960574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUyl6VQrGkmr1r4nF1875CYLJdWQj/cABbUbF2Fl1NisC2jIEXoWl6IkbMbqhaqnSs5OFjYV4xAe3p47I0DvfRYMzqIbhLi5/jEuY5VpMWDyCUphBAZulEA41PELnOCRA=="}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:23.447574 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for user a4a4230574c846a9b4f7edd240317ee9 and project 95c63194a18f4768abe23f55608ec8c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:09:23.473292 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:09:23.477618 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:09:23.582169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-0149dc71-652d-409f-9ae2-aff8432b9b52 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:09:23.594299 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-0149dc71-652d-409f-9ae2-aff8432b9b52 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for user 2cfba439a18a4c8e8fa0021380128447 and project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:09:23.747176 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-76669829-e758-4df7-95c7-fbd134472b70 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.124340 Oct 30 01:09:23.748327 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 14/26] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:09:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 5153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:09:23.858346 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0149dc71-652d-409f-9ae2-aff8432b9b52 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.147404 Oct 30 01:09:23.858346 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 13/27] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:09:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:23.858877 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e55fe2ea-9da0-4384-a878-c176d33a4d17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:23.858877 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e55fe2ea-9da0-4384-a878-c176d33a4d17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:23.983677 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e55fe2ea-9da0-4384-a878-c176d33a4d17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:24.002524 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e55fe2ea-9da0-4384-a878-c176d33a4d17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1221 microversion: 2.1 time: 0.241532 Oct 30 01:09:24.016236 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:23 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:25.122572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-315733592", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "networks": [{"uuid": "c367b002-822a-4b38-9fc4-12445dc4cb4a"}]}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:25.271613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] validate_networks() for [('c367b002-822a-4b38-9fc4-12445dc4cb4a', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:09:25.301173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-45553326", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:25.461935 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] validate_networks() for [('de618076-b93d-46d5-a096-a44e39256fff', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:09:26.441357 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:09:26.447162 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:09:26.447162 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:09:26.447162 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:09:26.447162 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:09:26.478344 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:26.480754 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:26.484296 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:26.490159 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:26.490953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:26.494677 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:26.578527 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for project 95c63194a18f4768abe23f55608ec8c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:09:26.587919 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for user a4a4230574c846a9b4f7edd240317ee9 and project 95c63194a18f4768abe23f55608ec8c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:09:26.632988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:09:26.642258 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:09:26.865197 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-baccf512-5b60-4689-808b-c0a19a51853f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.569093 Oct 30 01:09:26.875811 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 16/29] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:09:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:09:26.890329 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-234f5538-89fe-4b61-beca-00df54227088 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:26.890912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-234f5538-89fe-4b61-beca-00df54227088 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:27.409852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-234f5538-89fe-4b61-beca-00df54227088 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:27.419910 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-234f5538-89fe-4b61-beca-00df54227088 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1220 microversion: 2.1 time: 0.542828 Oct 30 01:09:27.447788 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 17/30] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:26 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1220 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:27.653169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:09:27.653749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:09:27.654055 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:09:27.654459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:09:27.654866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:09:27.728758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:27.739855 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:27.742716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:27.744457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:27.750428 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:27.754650 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:27.823808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Getting quotas for project 445041c33bf944d8a7a39281e3aba6c5. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:09:27.846223 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Getting quotas for user 3e12208f0ceb41c8bb3b69cbd62e78b2 and project 445041c33bf944d8a7a39281e3aba6c5. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:09:27.888318 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:09:27.909536 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:09:28.218185 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-429a200f-2514-461a-af56-2e2b70946ff0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.279806 Oct 30 01:09:28.232410 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 14/31] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:09:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:09:28.238772 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-398f72f7-5bd3-4041-b509-c41036fda1ce tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:28.243982 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-398f72f7-5bd3-4041-b509-c41036fda1ce tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:28.459241 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9cf1ac61-265b-401c-be41-5579cc5c18e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:28.460158 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9cf1ac61-265b-401c-be41-5579cc5c18e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:28.548524 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-398f72f7-5bd3-4041-b509-c41036fda1ce tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:28.561167 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-398f72f7-5bd3-4041-b509-c41036fda1ce tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1214 microversion: 2.1 time: 0.329932 Oct 30 01:09:28.561747 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 18/32] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:28 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1214 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:28.667179 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9cf1ac61-265b-401c-be41-5579cc5c18e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:28.701009 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9cf1ac61-265b-401c-be41-5579cc5c18e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1220 microversion: 2.1 time: 0.252129 Oct 30 01:09:28.702616 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 15/33] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:28 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1220 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:29.505024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-534753240", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22a05b54-ab8c-4e6c-b771-2b6e93826000"}], "security_groups": [{"name": "tempest-securitygroup--903139339"}], "key_name": "tempest-keypair-1224960574", "user_data": "}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:29.587623 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6c9c401d-848a-42b8-aaf3-2c2459fee69a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:29.589058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6c9c401d-848a-42b8-aaf3-2c2459fee69a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:29.803285 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6c9c401d-848a-42b8-aaf3-2c2459fee69a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:29.812271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] validate_networks() for [('22a05b54-ab8c-4e6c-b771-2b6e93826000', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:09:29.822896 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6c9c401d-848a-42b8-aaf3-2c2459fee69a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1214 microversion: 2.1 time: 0.235978 Oct 30 01:09:29.825353 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 16/34] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:29 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:29.847992 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:29.850801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:29.879452 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:29.885778 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:29.886238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:29.886987 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:29.887446 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:29.892627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:30.253586 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:30.292328 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1103b03c-32d7-4e3c-8408-16d676717e27 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1224 microversion: 2.1 time: 0.461417 Oct 30 01:09:30.293648 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 17/35] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:29 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1224 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:30.631312 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:09:30.632117 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:09:30.632805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:09:30.634312 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:09:30.634846 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:09:30.670616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:30.675187 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:30.676305 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:30.677402 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:30.678702 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:30.680064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:30.709491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:09:30.717925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for user 2cfba439a18a4c8e8fa0021380128447 and project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:09:30.751711 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:09:30.755454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:09:30.855510 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:30.856216 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:30.872890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:30.873388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:30.873876 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:30.874585 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:30.875298 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:30.875930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:31.015789 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:31.029533 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b9a22a53-eb08-4d99-925a-4ada3951793e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1218 microversion: 2.1 time: 0.185237 Oct 30 01:09:31.049263 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 18/36] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:30 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1218 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:31.070548 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3c829ac0-3c3d-4ba1-82e5-4b454bf26aaa tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.571094 Oct 30 01:09:31.070548 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:09:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:09:31.086631 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f3bc39ef-d0b7-4c0a-9be8-7de57b610fad tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:31.087891 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f3bc39ef-d0b7-4c0a-9be8-7de57b610fad tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:31.156784 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f3bc39ef-d0b7-4c0a-9be8-7de57b610fad tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:31.171248 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f3bc39ef-d0b7-4c0a-9be8-7de57b610fad tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1237 microversion: 2.1 time: 0.089319 Oct 30 01:09:31.171928 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:31 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:31.318962 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:31.319605 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:31.333067 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:31.333580 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:31.334144 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:31.338006 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:31.338565 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:31.339373 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:31.708556 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:31.735013 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fc9037c9-ba5f-4858-a08a-32b5ee4e4c7f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1272 microversion: 2.1 time: 0.422358 Oct 30 01:09:31.747895 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:31 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:32.066248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:32.069962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:32.100367 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:32.100881 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:32.105549 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:32.108424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:32.110342 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:32.110958 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:32.196493 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4478e27b-6180-4782-95a1-9c75736a0e03 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:32.197130 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4478e27b-6180-4782-95a1-9c75736a0e03 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:32.524853 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:32.541243 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c0213800-f485-4886-83c4-8c38f88e9598 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1266 microversion: 2.1 time: 0.482338 Oct 30 01:09:32.542361 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 20/40] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:32 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1266 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:32.561172 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4478e27b-6180-4782-95a1-9c75736a0e03 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:32.572830 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4478e27b-6180-4782-95a1-9c75736a0e03 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1237 microversion: 2.1 time: 0.380530 Oct 30 01:09:32.574578 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:32 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1237 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:32.762982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:32.763624 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:32.775274 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:32.776351 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:32.780422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:32.784845 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:32.784845 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:32.784845 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:33.088480 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:33.115241 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-94a8fbf8-8892-45f7-82f5-28cb74592c66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1278 microversion: 2.1 time: 0.356360 Oct 30 01:09:33.120773 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:32 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1278 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:33.572943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:33.573582 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:33.590263 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:33.590847 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:33.592655 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:33.600981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:33.601181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:33.602850 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:33.603038 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:33.607973 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:33.626035 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:33.629883 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:33.630315 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:33.633139 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:33.635832 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:33.642621 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:33.915004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:33.931527 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7a4fa7e6-b8c0-41a4-b543-aa261d55a5ed tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1274 microversion: 2.1 time: 0.362751 Oct 30 01:09:33.932326 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:33 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1274 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:33.963497 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:33.975921 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9bbddf14-7b85-493f-988c-81cafe5230f4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1241 microversion: 2.1 time: 0.377987 Oct 30 01:09:33.976532 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 22/44] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:33 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1241 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:34.161784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:34.161784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:34.169214 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:34.170106 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:34.170791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:34.171821 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:34.172601 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:34.173513 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:34.284573 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:34.297021 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d9ac7421-730c-4970-8ae3-05da64102487 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1278 microversion: 2.1 time: 0.148931 Oct 30 01:09:34.298045 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:34 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:34.963698 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:34.975291 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:34.992701 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:34.994622 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:34.995748 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:34.997982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:35.000958 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:35.001422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:35.007087 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:35.008381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:35.042338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:35.047983 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:35.049712 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:35.052845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:35.059184 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:35.061845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:35.349755 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:35.351201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:35.351655 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2e6cbf37-4185-4e72-aec8-b1c31c3d2a04 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1272 microversion: 2.1 time: 0.385692 Oct 30 01:09:35.352580 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 23/46] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:34 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1272 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:35.360103 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c90bc3a0-f35f-4b3e-a376-fb34bb2032dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1233 microversion: 2.1 time: 0.356179 Oct 30 01:09:35.362392 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:35.363248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:35.372958 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 24/47] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:35 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1233 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:35.381358 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:35.385162 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:35.385627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:35.386377 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:35.387654 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:35.388116 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:36.038973 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:36.082036 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e3c0c6c1-942b-455d-b196-600a136fcb78 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.713327 Oct 30 01:09:36.088411 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:35 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:36.377391 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:36.377391 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:36.400694 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:36.401597 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:36.402267 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:36.403066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:36.409794 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:36.410025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:36.410697 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:36.421818 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:36.458510 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:36.459171 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:36.459680 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:36.460436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:36.460902 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:36.461338 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:36.966269 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:36.982480 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5c9d5795-86c6-4bd4-a0bd-e1fdd2d0274d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1289 microversion: 2.1 time: 0.597306 Oct 30 01:09:36.985142 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 25/49] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:36 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1289 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:37.070632 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-11cbc3a2-569d-4dc7-8298-fd88a4552675 req-21713bc2-c940-44b4-a853-b3c3a274e7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89eececf-ad51-4cbd-832b-a2f9d5a6dca8", "tag": "a185d7cd-a5ab-4e8d-a4c4-2d137415dd18"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:37.089726 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-11cbc3a2-569d-4dc7-8298-fd88a4552675 req-21713bc2-c940-44b4-a853-b3c3a274e7ec service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:37.090622 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-11cbc3a2-569d-4dc7-8298-fd88a4552675 req-21713bc2-c940-44b4-a853-b3c3a274e7ec service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:37.091334 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-11cbc3a2-569d-4dc7-8298-fd88a4552675 req-21713bc2-c940-44b4-a853-b3c3a274e7ec service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:37.127410 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-11cbc3a2-569d-4dc7-8298-fd88a4552675 req-21713bc2-c940-44b4-a853-b3c3a274e7ec service nova] Creating event network-changed:a185d7cd-a5ab-4e8d-a4c4-2d137415dd18 for instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 on hv-cinder-maste Oct 30 01:09:37.128242 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-11cbc3a2-569d-4dc7-8298-fd88a4552675 req-21713bc2-c940-44b4-a853-b3c3a274e7ec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:09:37.128788 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-11cbc3a2-569d-4dc7-8298-fd88a4552675 req-21713bc2-c940-44b4-a853-b3c3a274e7ec service nova] Acquired lock "compute-rpcapi-router" {{(pid=119523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:09:37.130060 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:37.130521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:37.131105 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:37.132161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:37.132613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:37.133206 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:37.143958 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.compute.rpcapi [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 30 01:09:37.145125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] Releasing lock "compute-rpcapi-router" {{(pid=119523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:09:37.163963 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-26a67656-c205-4b80-8a87-98586d0e4c52 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175574 Oct 30 01:09:37.164903 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 26/50] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:37.173115 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:37.174464 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:37.181662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:37.182519 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:37.183395 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:37.184342 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:37.185027 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:37.185569 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:37.279130 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:37.307983 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-83ca550d-41c3-4423-802f-0993dda904b7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.931157 Oct 30 01:09:37.308603 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 25/51] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:36 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:38.012152 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:38.013086 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:38.033183 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:38.033728 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:38.034399 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:38.035317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:38.035998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:38.036630 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:38.144869 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:38.158401 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-919c46f9-c446-43c5-a297-6651bd3abc75 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.992105 Oct 30 01:09:38.160593 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:37 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:38.285630 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:38.299834 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-99045e5a-50d0-4190-adcf-666e5551ccd0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1297 microversion: 2.1 time: 0.291201 Oct 30 01:09:38.312542 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 26/53] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:38 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1297 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:38.337495 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:38.338208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:38.351988 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:38.352960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:38.367290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:38.370192 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:38.370902 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:38.371531 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:38.942820 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:38.952228 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5cfc33ff-9056-43f3-b65f-4096df83ad87 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.619848 Oct 30 01:09:38.952883 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 28/54] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:38 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:39.184943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:39.186890 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:39.195400 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:39.197684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:39.198405 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:39.200399 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:39.201128 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:39.201782 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:39.348515 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:39.348515 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:39.350992 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:39.351573 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:39.352660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:39.354643 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:39.355769 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:39.356271 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:39.534393 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:39.560532 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ef8188cf-7d4f-4209-86ae-407e7947e2a4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1295 microversion: 2.1 time: 0.227697 Oct 30 01:09:39.566249 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 29/55] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:39 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1295 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:40.036135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:40.036135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:40.036135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:40.036135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:40.037284 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:40.037284 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:40.037284 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:40.037284 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:40.053735 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:40.070321 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-62faa31a-ea9d-4312-8159-11cd904e5593 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.883515 Oct 30 01:09:40.072974 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 27/56] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:39 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:40.600559 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-63eacdba-92e3-4682-b9fe-8753d1035f22 req-2eef6e6b-430c-439b-845f-d9a5b3f821b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce81348d-b898-4087-8f2e-0b820ce0d9ce", "tag": "fde77b6d-0e95-4d06-964a-83f5fdd6e5e9"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:40.646834 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:40.660413 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-280b5c50-3cd1-412c-806b-6834b30c420e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.684920 Oct 30 01:09:40.661038 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 30/57] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:39 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:40.667203 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-63eacdba-92e3-4682-b9fe-8753d1035f22 req-2eef6e6b-430c-439b-845f-d9a5b3f821b8 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:40.672337 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-63eacdba-92e3-4682-b9fe-8753d1035f22 req-2eef6e6b-430c-439b-845f-d9a5b3f821b8 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:40.674682 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-63eacdba-92e3-4682-b9fe-8753d1035f22 req-2eef6e6b-430c-439b-845f-d9a5b3f821b8 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:40.685620 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:40.687092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:40.713348 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:40.717026 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:40.723850 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:40.725071 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:40.728215 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:40.731072 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:40.732857 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=6 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:40.751388 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-63eacdba-92e3-4682-b9fe-8753d1035f22 req-2eef6e6b-430c-439b-845f-d9a5b3f821b8 service nova] Creating event network-changed:fde77b6d-0e95-4d06-964a-83f5fdd6e5e9 for instance ce81348d-b898-4087-8f2e-0b820ce0d9ce on hv-cinder-maste Oct 30 01:09:40.768252 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-63eacdba-92e3-4682-b9fe-8753d1035f22 req-2eef6e6b-430c-439b-845f-d9a5b3f821b8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:09:40.772022 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-63eacdba-92e3-4682-b9fe-8753d1035f22 req-2eef6e6b-430c-439b-845f-d9a5b3f821b8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:09:40.779842 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:40.782323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:40.783129 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:40.784180 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:40.784841 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:40.785458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:40.816901 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.compute.rpcapi [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 30 01:09:40.817810 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] Releasing lock "compute-rpcapi-router" {{(pid=119524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:09:40.856931 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9560db9d-ab3f-460d-a892-ecb54f095a14 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546324 Oct 30 01:09:40.860334 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 28/58] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:41.249475 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:41.249475 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-db07d05e-1fcc-4d82-bd58-640ff37eabf4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1295 microversion: 2.1 time: 0.355546 Oct 30 01:09:41.249475 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:40 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1295 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:41.251365 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:41.251365 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:41.251365 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:41.251365 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:41.254853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:41.254853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:41.254853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:41.254853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:41.260647 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:41.277560 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f1339a97-c097-40e8-94a1-1a0fbee04959 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.180503 Oct 30 01:09:41.281309 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 29/60] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:41 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:41.684289 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:41.684913 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:41.687150 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=16 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:41.716153 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:41.718155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:41.726846 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:41.728295 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:41.729925 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:41.733686 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:42.072401 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:42.072401 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:42.072401 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:42.072401 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:42.076338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:42.076338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:42.076338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:42.076338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:42.246044 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:42.257665 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b4d9e9a2-2281-424c-977a-9895c8db049b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.577133 Oct 30 01:09:42.269687 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 32/61] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:41 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:42.312306 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:42.313921 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:42.328673 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:42.329659 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:42.330460 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:42.332225 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:42.333437 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:42.334440 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:42.548280 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:42.587608 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a704dae6-7fd1-4610-bc42-231e96b43c9b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.526797 Oct 30 01:09:42.590063 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 30/62] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:42 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:42.771567 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:42.790672 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2ffcd82e-cba0-4c1f-9bf0-13767b873b29 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.473048 Oct 30 01:09:42.790672 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:42 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:42.891561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-b2e72a8f-5753-4017-bac4-699cf23b93ce req-fea0c9ae-488a-4154-b5e2-35903583c6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6eded78-b511-4e4a-a62d-320226461b59", "tag": "e79ba46a-fdc8-4e6c-a266-c30784d84a8b"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:42.945528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=26 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:42.953150 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-b2e72a8f-5753-4017-bac4-699cf23b93ce req-fea0c9ae-488a-4154-b5e2-35903583c6e5 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:42.963938 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-b2e72a8f-5753-4017-bac4-699cf23b93ce req-fea0c9ae-488a-4154-b5e2-35903583c6e5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:42.965097 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-b2e72a8f-5753-4017-bac4-699cf23b93ce req-fea0c9ae-488a-4154-b5e2-35903583c6e5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:43.006181 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-b2e72a8f-5753-4017-bac4-699cf23b93ce req-fea0c9ae-488a-4154-b5e2-35903583c6e5 service nova] Creating event network-changed:e79ba46a-fdc8-4e6c-a266-c30784d84a8b for instance d6eded78-b511-4e4a-a62d-320226461b59 on hv-cinder-maste Oct 30 01:09:43.020053 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-b2e72a8f-5753-4017-bac4-699cf23b93ce req-fea0c9ae-488a-4154-b5e2-35903583c6e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130153 Oct 30 01:09:43.020876 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 31/64] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:43.286974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:43.287923 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:43.299673 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:43.306890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:43.307558 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:43.308581 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:43.309234 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:43.309922 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:43.375260 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:43.622209 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:43.633413 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:43.654788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:43.656952 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:43.657407 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:43.658294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:43.658693 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:43.658878 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:43.659211 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:43.670682 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1b40a31a-704e-40bb-9bc0-1dcde7f103ba tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.386756 Oct 30 01:09:43.674680 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 34/65] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:43 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:43.817731 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:43.819935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:43.835424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:43.837636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:43.837837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:43.840119 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:43.842701 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:43.843821 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:44.239284 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:44.253072 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-987cc025-c5f9-4c2c-a321-2d958debaf9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.639201 Oct 30 01:09:44.265374 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 32/66] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:43 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:44.392950 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:44.406408 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d5166f64-8fed-4696-83a7-fa58eb8ca15f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.594509 Oct 30 01:09:44.409310 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 35/67] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:43 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:44.699242 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:44.700824 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:44.721141 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:44.722912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:44.724231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:44.729582 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:44.738452 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:44.741822 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:45.048764 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-15e01423-688e-458b-ad5b-30d744f65212 req-8af6e9a4-05b1-42c7-b67f-38ec451dc1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb", "tag": "e110a9e6-b871-4b2d-8aa2-faebc5bffc4d"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:45.059780 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-15e01423-688e-458b-ad5b-30d744f65212 req-8af6e9a4-05b1-42c7-b67f-38ec451dc1a0 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:45.060253 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-15e01423-688e-458b-ad5b-30d744f65212 req-8af6e9a4-05b1-42c7-b67f-38ec451dc1a0 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:45.060676 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-15e01423-688e-458b-ad5b-30d744f65212 req-8af6e9a4-05b1-42c7-b67f-38ec451dc1a0 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:45.064276 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:45.066678 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=77 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:45.072226 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-15e01423-688e-458b-ad5b-30d744f65212 req-8af6e9a4-05b1-42c7-b67f-38ec451dc1a0 service nova] Creating event network-changed:e110a9e6-b871-4b2d-8aa2-faebc5bffc4d for instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb on hv-cinder-maste Oct 30 01:09:45.073145 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-371ab906-5d99-4c84-a371-5663f6004e7d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.382274 Oct 30 01:09:45.083743 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 33/68] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:44 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:45.090662 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-15e01423-688e-458b-ad5b-30d744f65212 req-8af6e9a4-05b1-42c7-b67f-38ec451dc1a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045460 Oct 30 01:09:45.092014 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 36/69] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:45.280368 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:45.283450 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:45.292919 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:45.293886 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:45.294688 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:45.295959 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:45.297005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:45.297753 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:45.432803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:45.433586 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:45.440117 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:45.444181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:45.444181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:45.444181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:45.444181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:45.444588 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:45.457922 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:45.465936 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-43147daa-9d97-49e1-aa43-ff6900a9247e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.192830 Oct 30 01:09:45.466778 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 34/70] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:45 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:45.585668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:45.594413 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f61660d3-7f5a-4b21-a0fb-01f4eefedecf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.165712 Oct 30 01:09:45.594985 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 37/71] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:45 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:46.096195 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:46.096876 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:46.103399 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:46.103924 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:46.104337 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:46.105022 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:46.105474 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:46.105897 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:46.254929 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:46.274934 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ba44279c-bd27-42bf-a495-398ecf64254a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.180611 Oct 30 01:09:46.287815 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 35/72] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:46 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:46.492697 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:46.494260 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:46.503627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:46.504724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:46.505758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:46.506581 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:46.507332 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:46.508344 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:46.619218 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:46.621367 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:46.645701 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:46.654373 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:46.654891 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:46.658646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:46.662099 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:46.662099 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:46.662099 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:46.776806 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:46.786825 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e5efd9a1-52d7-47f3-af8e-06405fcc4b63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.301070 Oct 30 01:09:46.795917 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 38/73] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:46 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:47.007648 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:47.030364 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8babef48-c4ce-49f3-aa29-be43f39fd0a0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.404310 Oct 30 01:09:47.030364 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 36/74] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:46 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:47.298175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:47.298776 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:47.300734 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=4 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:47.307254 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:47.307758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:47.308300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:47.309298 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:47.309764 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:47.310279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:47.459796 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:47.468300 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ccbb4ce4-7fb7-4df9-bf20-d484dd25488e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.173755 Oct 30 01:09:47.479742 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 39/75] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:47 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:47.813947 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:47.816027 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:47.830204 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:47.830793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:47.831254 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:47.831986 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:47.832434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:47.832921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:47.968888 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:47.976908 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-df19468d-a239-45d2-ac5c-2e6ef91f075a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.168247 Oct 30 01:09:47.978051 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 37/76] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:47 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:48.043796 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:48.044402 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:48.050473 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:48.050939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:48.051369 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:48.052076 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:48.052523 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:48.052932 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:48.213609 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:48.228065 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-aff5e5ab-f4a5-4607-af5e-21ace66b1902 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.188382 Oct 30 01:09:48.230428 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 40/77] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:48 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:48.493688 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:48.494301 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:48.500591 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:48.501080 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:48.501505 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:48.502266 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:48.502715 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:48.503145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:48.656334 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:48.664888 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-eb397c46-2577-4ac8-bb90-1f9569c5f1a5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.176963 Oct 30 01:09:48.665473 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 38/78] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:48 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:49.000652 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:49.001304 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:49.007682 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:49.011461 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:49.011461 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:49.011461 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:49.011461 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:49.011934 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:49.161869 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:49.170482 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-75d73adf-025d-42d7-ba5f-1238da106de6 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.174230 Oct 30 01:09:49.184888 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 41/79] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:48 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:49.252182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:49.255271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:49.269454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:49.273038 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:49.273680 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:49.277435 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:49.278340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:49.279075 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:49.631430 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:49.643396 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f014e143-6ff6-4c13-b7d6-0a4a36b03442 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.395270 Oct 30 01:09:49.647052 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 39/80] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:49 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:49.691119 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:49.691856 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:49.709003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:49.709502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:49.709933 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:49.710653 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:49.711095 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:49.712079 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:50.001259 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:50.011917 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-346839de-c5ca-45ee-b444-90f2e17d6d11 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.326248 Oct 30 01:09:50.012605 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 42/81] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:49 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:50.196232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:50.196766 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:50.211001 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:50.211001 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:50.211001 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:50.211001 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:50.211510 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:50.211510 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:50.424639 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:50.436450 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9cb42c7a-b6fd-4080-abdb-b94debb019d3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.244723 Oct 30 01:09:50.437268 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 40/82] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:50 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:50.676623 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:50.677319 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:50.683944 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:50.684437 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:50.684937 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:50.685646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:50.686101 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:50.686519 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:50.827814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:50.836999 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a990e4d7-accd-4d16-9b11-6f20e7e19fed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.164244 Oct 30 01:09:50.837830 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 43/83] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:50 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:51.042087 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:51.042695 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:51.048873 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:51.049384 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:51.049949 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:51.050652 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:51.051202 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:51.051535 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:51.190752 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:51.198621 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b182a0da-f283-460d-a630-419692665714 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.160868 Oct 30 01:09:51.199359 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 41/84] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:51 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:51.467033 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:51.470436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:51.492368 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:51.493708 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:51.494457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:51.498699 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:51.502379 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:51.507764 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:51.806201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:51.817677 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2066f572-dbac-4efd-8121-79d698e664d4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.358458 Oct 30 01:09:51.820356 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 44/85] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:51 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:51.862974 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:51.864147 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:51.872385 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:51.873069 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:51.875081 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:51.876033 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:51.877302 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:51.878270 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:52.154996 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:52.169118 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-55b6aabc-fa2e-4487-95cf-8071e6a84e17 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.312259 Oct 30 01:09:52.175693 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 42/86] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:51 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:52.223404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:52.227980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:52.238624 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:52.240752 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:52.241446 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:52.242191 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:52.243289 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:52.248188 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:52.424278 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:52.439259 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d04cf7ec-9517-45e7-935e-43a1ca34cccb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.220614 Oct 30 01:09:52.457077 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 45/87] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:52 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:52.843880 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:52.845837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:52.856872 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:52.862181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:52.866041 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:52.866657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:52.867570 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:52.868573 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:52.873766 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:52.935992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:53.028997 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-ee214c46-67fc-4265-9fb3-1eaaa2f01518 req-21421598-013f-4c7b-9024-51dd3db0cb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89eececf-ad51-4cbd-832b-a2f9d5a6dca8", "name": "network-vif-plugged", "status": "completed", "tag": "a185d7cd-a5ab-4e8d-a4c4-2d137415dd18"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:53.047095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-ee214c46-67fc-4265-9fb3-1eaaa2f01518 req-21421598-013f-4c7b-9024-51dd3db0cb3d service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:53.047783 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-ee214c46-67fc-4265-9fb3-1eaaa2f01518 req-21421598-013f-4c7b-9024-51dd3db0cb3d service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:53.048361 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-ee214c46-67fc-4265-9fb3-1eaaa2f01518 req-21421598-013f-4c7b-9024-51dd3db0cb3d service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:53.102684 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-ee214c46-67fc-4265-9fb3-1eaaa2f01518 req-21421598-013f-4c7b-9024-51dd3db0cb3d service nova] Creating event network-vif-plugged:a185d7cd-a5ab-4e8d-a4c4-2d137415dd18 for instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 on hv-cinder-maste Oct 30 01:09:53.106177 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:53.110241 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-ee214c46-67fc-4265-9fb3-1eaaa2f01518 req-21421598-013f-4c7b-9024-51dd3db0cb3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.567180 Oct 30 01:09:53.111360 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 43/88] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:53.118830 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-41f341cb-db8c-46ea-bbdc-9754eefd956b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.279368 Oct 30 01:09:53.123033 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 46/89] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:52 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:53.201447 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:53.202448 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:53.217921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:53.219796 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:53.221656 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:53.221656 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:53.221656 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:53.221889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:53.462894 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:53.463572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:53.469927 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:53.470419 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:53.470857 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:53.471556 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:53.472031 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:53.472572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:53.486020 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:53.490891 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d498edb2-40e9-407e-9bfd-260c0d4251d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.294197 Oct 30 01:09:53.491473 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 44/90] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:53 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:53.615720 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:53.634663 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-197d134d-b619-4809-9a58-15561f03579a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.175506 Oct 30 01:09:53.636206 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 47/91] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:53 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:54.155636 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:54.156411 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:54.163991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:54.164715 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:54.165310 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:54.166298 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:54.167101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:54.167710 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:54.360733 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:54.369485 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-35396702-f300-45e0-8a34-bdcdc5bfd2bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.220451 Oct 30 01:09:54.370065 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 45/92] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:54 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:54.516557 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:54.517240 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:54.523878 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:54.524361 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:54.524800 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:54.525492 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:54.525947 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:54.526367 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:54.660420 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:54.661112 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:54.676998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:54.677865 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:54.683334 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:54.685685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:54.691731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:54.692701 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:54.693463 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:54.699111 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-341cb4f7-0dac-465f-bb51-f288fda254a3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.187229 Oct 30 01:09:54.704379 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 48/93] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:54 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:55.075436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:55.090505 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f9d9cc03-afa9-43e5-89f7-356eb0829fab tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.428495 Oct 30 01:09:55.094746 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 46/94] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:54 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:55.139078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-a326f718-d1c5-4897-9b35-6b7c03888040 req-a68e76c1-e933-4cb6-b462-eca2f3e72d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce81348d-b898-4087-8f2e-0b820ce0d9ce", "name": "network-vif-plugged", "status": "completed", "tag": "fde77b6d-0e95-4d06-964a-83f5fdd6e5e9"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:55.148993 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a326f718-d1c5-4897-9b35-6b7c03888040 req-a68e76c1-e933-4cb6-b462-eca2f3e72d3d service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:55.149477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a326f718-d1c5-4897-9b35-6b7c03888040 req-a68e76c1-e933-4cb6-b462-eca2f3e72d3d service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:55.149897 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a326f718-d1c5-4897-9b35-6b7c03888040 req-a68e76c1-e933-4cb6-b462-eca2f3e72d3d service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:55.161352 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-a326f718-d1c5-4897-9b35-6b7c03888040 req-a68e76c1-e933-4cb6-b462-eca2f3e72d3d service nova] Creating event network-vif-plugged:fde77b6d-0e95-4d06-964a-83f5fdd6e5e9 for instance ce81348d-b898-4087-8f2e-0b820ce0d9ce on hv-cinder-maste Oct 30 01:09:55.167093 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-a326f718-d1c5-4897-9b35-6b7c03888040 req-a68e76c1-e933-4cb6-b462-eca2f3e72d3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Oct 30 01:09:55.167728 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 49/95] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:09:55.392255 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:55.398384 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:55.400787 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:55.404353 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:55.405607 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:55.406444 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:55.407201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:55.407673 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:55.642374 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:55.655525 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d786aea0-f133-4c4e-b3cb-b6ae35a41c85 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.266936 Oct 30 01:09:55.673217 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 47/96] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:55 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:55.723255 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:55.724344 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:55.731799 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:55.732441 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:55.732978 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:55.733820 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:55.734426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:55.735317 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:56.004470 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:56.015561 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f8adb164-da46-46fe-9fd2-02af5106b689 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.296519 Oct 30 01:09:56.021298 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 50/97] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:55 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:56.118856 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:56.118856 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:56.123032 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:56.123624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:56.124143 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:56.125276 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:56.125873 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:56.126426 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:56.327553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:56.349833 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1818ea06-cf51-4db4-97ca-2452ffa271f7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.224824 Oct 30 01:09:56.349833 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 48/98] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:56 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:56.699897 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:56.700873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:56.707841 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:56.708586 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:56.709021 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:56.709900 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:56.710709 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:56.711267 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:56.880516 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:56.889136 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-58bfc434-3f4e-47f9-890f-4688ba92e7e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.193263 Oct 30 01:09:56.905045 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 51/99] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:56 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:57.045568 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:57.046168 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:57.053454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:57.054541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:57.055241 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:57.055922 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:57.056406 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:57.056833 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:57.183644 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-49d33118-7682-4e23-b60c-2ad60e0ed396 req-101ddf74-1d10-414a-9984-5b46cdddc355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb", "name": "network-vif-plugged", "status": "completed", "tag": "e110a9e6-b871-4b2d-8aa2-faebc5bffc4d"}, {"server_uuid": "d6eded78-b511-4e4a-a62d-320226461b59", "name": "network-vif-plugged", "status": "completed", "tag": "e79ba46a-fdc8-4e6c-a266-c30784d84a8b"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:57.201979 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-49d33118-7682-4e23-b60c-2ad60e0ed396 req-101ddf74-1d10-414a-9984-5b46cdddc355 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:57.202856 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-49d33118-7682-4e23-b60c-2ad60e0ed396 req-101ddf74-1d10-414a-9984-5b46cdddc355 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:57.210541 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-49d33118-7682-4e23-b60c-2ad60e0ed396 req-101ddf74-1d10-414a-9984-5b46cdddc355 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:57.224503 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-49d33118-7682-4e23-b60c-2ad60e0ed396 req-101ddf74-1d10-414a-9984-5b46cdddc355 service nova] Creating event network-vif-plugged:e110a9e6-b871-4b2d-8aa2-faebc5bffc4d for instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb on hv-cinder-maste Oct 30 01:09:57.225276 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-49d33118-7682-4e23-b60c-2ad60e0ed396 req-101ddf74-1d10-414a-9984-5b46cdddc355 service nova] Creating event network-vif-plugged:e79ba46a-fdc8-4e6c-a266-c30784d84a8b for instance d6eded78-b511-4e4a-a62d-320226461b59 on hv-cinder-maste Oct 30 01:09:57.239675 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-49d33118-7682-4e23-b60c-2ad60e0ed396 req-101ddf74-1d10-414a-9984-5b46cdddc355 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055682 Oct 30 01:09:57.239675 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 52/100] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:09:57.314386 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:57.323417 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c5fb5a1b-ad7b-46fc-9302-2ff4e5279ee3 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1320 microversion: 2.1 time: 0.281773 Oct 30 01:09:57.324549 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 49/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:57 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:57.367479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:57.369939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:57.379716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:57.380206 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:57.380704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:57.381576 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:57.382210 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:57.383489 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:57.389906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:57.548543 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:57.556433 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7559a11a-d1d2-4d37-b591-65e0646814bb tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.199757 Oct 30 01:09:57.557000 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 53/102] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:57 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:57.916063 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:57.916829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:57.923248 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:57.924074 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:57.924743 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:57.925672 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:57.926248 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:57.926672 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:58.087657 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:58.100762 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-92859add-5e5e-4eda-b62f-d6f3913bb572 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.186347 Oct 30 01:09:58.103912 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 50/103] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:57 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:58.366234 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:58.368361 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:58.383099 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:58.385079 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:58.385530 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:58.386611 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:58.390389 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:58.391249 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:58.579571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:58.584919 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:58.585524 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:58.602156 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ea82c2b8-419f-4bd1-9488-053094de40bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1514 microversion: 2.1 time: 0.240330 Oct 30 01:09:58.615690 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 54/104] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:58 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:58.615909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:58.615909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:58.615909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:58.615909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:58.616171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:58.616171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:58.627422 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=100 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:09:58.631989 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:09:58.634385 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:58.643431 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:58.643431 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:58.643431 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:58.643431 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:58.643808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:58.643808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:58.713976 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'flavor' on Instance uuid ce81348d-b898-4087-8f2e-0b820ce0d9ce {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:09:58.831134 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:58.848468 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-dabce2a7-ebbc-4e63-badc-cc14a8a893dc tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.272671 Oct 30 01:09:58.850385 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 51/105] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:58 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:09:59.108719 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c1472bb9-7cc1-480f-abae-178f887625b7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce/action" status: 200 len: 32 microversion: 2.1 time: 0.485160 Oct 30 01:09:59.115770 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 55/106] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:09:58 2022] POST /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce/action => generated 32 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:09:59.121872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:59.123098 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:59.125641 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:59.126454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:59.130775 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:59.131309 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:59.132054 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:59.133533 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:59.133911 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:59.134402 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:59.134799 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:59.134917 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:59.135525 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:59.135779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:59.136276 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:59.136704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:59.360952 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:59.365790 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:09:59.372819 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-163e5472-5f86-423f-85dd-bc2a6cfbc247 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.251796 Oct 30 01:09:59.374969 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 56/107] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:59 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:59.375838 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-15ce218f-ee03-47b6-82c8-2aa5e7cff132 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.260384 Oct 30 01:09:59.376544 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 52/108] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:59 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:09:59.876968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:09:59.877613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:09:59.887692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:59.888244 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:59.895897 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:09:59.896942 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:09:59.897577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:09:59.898161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:00.133087 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:00.145018 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4746c817-4cab-45f4-90fc-ee383971015d tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1314 microversion: 2.1 time: 0.271379 Oct 30 01:10:00.147882 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 57/109] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:09:59 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:00.398290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:00.399446 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:00.400949 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:00.401879 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:00.409646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:00.410141 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:00.410589 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:00.411291 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:00.411808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:00.412382 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:00.412836 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:00.413327 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:00.419994 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:00.420741 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:00.421199 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:00.421836 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:00.673327 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:00.684550 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3a3c044c-0f55-4557-bc10-6768ab6981c5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.288070 Oct 30 01:10:00.685953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:00.687107 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 58/110] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:00 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:00.708835 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-06088742-6591-43ba-962f-f4fc2599303a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1362 microversion: 2.1 time: 0.314298 Oct 30 01:10:00.710423 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 53/111] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:00 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:01.172988 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:01.173598 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:01.179607 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:01.180316 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:01.180752 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:01.181452 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:01.182068 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:01.182495 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:01.328273 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:01.340182 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c37893e7-fc15-4d69-aa38-9805f9922fb5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1500 microversion: 2.1 time: 0.170730 Oct 30 01:10:01.341432 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 59/112] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:01 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:01.713229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:01.714200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:01.727363 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:01.734320 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:01.734879 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:01.735482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:01.736144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:01.737855 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:01.738624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:01.739418 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:01.745279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:01.745650 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:01.749578 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:01.750471 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:01.752141 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:01.752576 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:02.051021 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:02.061374 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-aab2ef13-a84a-412e-9f7f-0b46fd1d9dc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.353059 Oct 30 01:10:02.073028 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 54/113] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:01 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:02.084647 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:02.089937 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d522c47e-6efd-4795-a050-823c26fd9f63 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1549 microversion: 2.1 time: 0.358238 Oct 30 01:10:02.091255 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 60/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:01 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1549 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:02.122205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:02.122793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:02.129976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:02.130873 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:02.131370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:02.132180 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:02.132868 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:02.133351 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:02.306050 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-27ced105-cf9c-4c5a-90ed-dfe9004774da tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185428 Oct 30 01:10:02.316276 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 55/115] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:10:02 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:03.092151 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:03.093232 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:03.103819 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:03.104675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:03.105682 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:03.106877 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:03.107994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:03.108877 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:03.880967 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:03.892379 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f8d84309-c48e-495e-88af-e639ffe90a12 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.807391 Oct 30 01:10:03.893679 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 61/116] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:03 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:04.801847 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-afd8b6a3-cc0f-4b55-afd2-9f3f1ccf5a24 req-ed7ea9b0-91fc-4a5c-9cd1-cf6c34861b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb", "tag": "e110a9e6-b871-4b2d-8aa2-faebc5bffc4d"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:04.834332 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-afd8b6a3-cc0f-4b55-afd2-9f3f1ccf5a24 req-ed7ea9b0-91fc-4a5c-9cd1-cf6c34861b14 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.835134 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-afd8b6a3-cc0f-4b55-afd2-9f3f1ccf5a24 req-ed7ea9b0-91fc-4a5c-9cd1-cf6c34861b14 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.835902 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-afd8b6a3-cc0f-4b55-afd2-9f3f1ccf5a24 req-ed7ea9b0-91fc-4a5c-9cd1-cf6c34861b14 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:04.858536 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-afd8b6a3-cc0f-4b55-afd2-9f3f1ccf5a24 req-ed7ea9b0-91fc-4a5c-9cd1-cf6c34861b14 service nova] Creating event network-changed:e110a9e6-b871-4b2d-8aa2-faebc5bffc4d for instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb on hv-cinder-maste Oct 30 01:10:04.868668 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-afd8b6a3-cc0f-4b55-afd2-9f3f1ccf5a24 req-ed7ea9b0-91fc-4a5c-9cd1-cf6c34861b14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076009 Oct 30 01:10:04.869609 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 56/117] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 30 01:10:04.969544 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:04.970991 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:04.994011 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.995011 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.995839 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:04.997156 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.997969 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.998835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:05.376286 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:05.393478 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-95842137-2e93-406b-81a6-0a4ed6b7c817 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.464298 Oct 30 01:10:05.404358 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 62/118] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:04 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:05.526413 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a2ac489-615b-4d21-bf6b-3951dab48193"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:05.533122 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:05.549985 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:05.551500 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:05.552525 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:05.554248 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:05.555311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:05.556777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:06.468270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:06.468270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:06.491509 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:06.493265 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:06.494333 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:06.496256 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:06.497701 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:06.498712 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:06.780193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:06.798250 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c33fbaca-781f-41e0-9b81-d761316d4a32 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.336916 Oct 30 01:10:06.799366 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 63/119] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:06 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:07.538564 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-412f9ea0-77eb-4eff-81e6-c88f15ff6e09 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "POST /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.025028 Oct 30 01:10:07.539643 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 57/120] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:10:05 2022] POST /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59/os-volume_attachments => generated 194 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:07.824102 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:07.824724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:07.833169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:07.833662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:07.834096 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:07.834807 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:07.835257 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:07.835756 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:07.984482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:07.992495 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ff2781d9-d4a8-4b18-a466-2a294f12c414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.172868 Oct 30 01:10:07.994124 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 64/121] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:07 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:09.018058 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:09.019524 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:09.033643 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:09.034559 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:09.035209 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:09.036040 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:09.036690 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:09.037348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:09.228247 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:09.245843 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e58cd808-d93f-45a0-add0-ea7c395459f9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.232177 Oct 30 01:10:09.247214 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 58/122] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:09 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:10.275047 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:10.276166 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:10.287503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:10.288436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:10.289181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:10.290476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:10.291369 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:10.292252 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:10.450468 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:10.464815 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-18dec1e2-85fb-494c-8880-84a28d0c0bac tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.197540 Oct 30 01:10:10.466074 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 65/123] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:10 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:11.498371 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:11.498371 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:11.512376 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:11.513460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:11.514246 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:11.515502 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:11.516466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:11.517240 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:11.780231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:11.795007 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c860161d-97c6-4331-b6dc-d299c8e1b3e5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.308395 Oct 30 01:10:11.796278 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 59/124] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:11 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:12.825426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:12.826182 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:12.834643 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:12.835632 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:12.836156 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:12.837367 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:12.838078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:12.838801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:12.922840 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:12.925539 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:12.935120 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:12.937317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:12.937317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:12.938234 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:12.938869 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:12.939802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:12.979425 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:10:13.075783 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:13.084465 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-859136e8-2041-40e0-af25-7b245cb761e4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.266373 Oct 30 01:10:13.085390 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 66/125] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:12 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:13.484614 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f1f60327-2d7d-4ce5-8b7a-74482e25a688 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 204 len: 0 microversion: 2.1 time: 0.564959 Oct 30 01:10:13.485856 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 60/126] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:10:12 2022] DELETE /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:10:13.498585 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:13.499798 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:13.510108 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:13.511037 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:13.511817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:13.513008 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:13.514499 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:13.514720 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:13.785666 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:13.792200 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:13.802603 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d9a2c3a7-5001-4c56-8432-e718f3c1f55e tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1552 microversion: 2.1 time: 0.310569 Oct 30 01:10:13.803814 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 67/127] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:13 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1552 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:14.111385 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:14.112918 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:14.141685 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:14.142912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:14.143901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:14.146012 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:14.146611 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:14.147627 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:14.500093 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:14.510193 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-40b37d4e-c56f-4083-8b5a-9fb255f6e389 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.405039 Oct 30 01:10:14.526371 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 61/128] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:14 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:14.835337 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:14.836901 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:14.846500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:14.847306 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:14.849113 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:14.850421 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:14.851883 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:14.853064 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:15.139976 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:15.155026 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c408b50f-224b-4a17-9d00-b9e60dbd2ad5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1552 microversion: 2.1 time: 0.324261 Oct 30 01:10:15.157086 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 68/129] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:14 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1552 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:15.534197 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:15.534891 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:15.542225 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:15.542708 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:15.543138 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:15.543883 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:15.544332 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:15.544742 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:15.834105 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:15.850309 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4f125d8e-7dfe-4ae1-a231-f785bfb79dfc tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.319782 Oct 30 01:10:15.851956 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 62/130] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:15 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:16.198011 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:16.198708 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:16.208845 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:16.214220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:16.214220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:16.214220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:16.214220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:16.214968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:16.599690 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:16.610212 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0098560f-bcc9-45bf-b2ae-23cde25b9bd7 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1552 microversion: 2.1 time: 0.418004 Oct 30 01:10:16.611186 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 69/131] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:16 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1552 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:16.895108 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:16.896193 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:16.921883 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:16.930031 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:16.931699 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:16.932862 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:16.933635 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:16.934371 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:17.269474 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:17.303778 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-47504663-d0ca-45bc-8798-e8b7caac8c3a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.407645 Oct 30 01:10:17.306776 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 63/132] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:16 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:17.504661 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-75a70fbf-277c-4486-917e-13a88cf0515b req-9728dcb3-db9c-4814-924e-6ca3c476b973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eded78-b511-4e4a-a62d-320226461b59", "name": "network-vif-deleted", "tag": "e79ba46a-fdc8-4e6c-a266-c30784d84a8b"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:17.528501 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-75a70fbf-277c-4486-917e-13a88cf0515b req-9728dcb3-db9c-4814-924e-6ca3c476b973 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:17.529310 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-75a70fbf-277c-4486-917e-13a88cf0515b req-9728dcb3-db9c-4814-924e-6ca3c476b973 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:17.530112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-75a70fbf-277c-4486-917e-13a88cf0515b req-9728dcb3-db9c-4814-924e-6ca3c476b973 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:17.558087 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-75a70fbf-277c-4486-917e-13a88cf0515b req-9728dcb3-db9c-4814-924e-6ca3c476b973 service nova] Creating event network-vif-deleted:e79ba46a-fdc8-4e6c-a266-c30784d84a8b for instance d6eded78-b511-4e4a-a62d-320226461b59 on hv-cinder-maste Oct 30 01:10:17.568385 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-75a70fbf-277c-4486-917e-13a88cf0515b req-9728dcb3-db9c-4814-924e-6ca3c476b973 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069377 Oct 30 01:10:17.569953 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 70/133] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:10:17.640739 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:17.649453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:17.656767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:17.657434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:17.658103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:17.659177 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:17.659506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:17.659963 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:17.741488 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:17.754741 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6b55bc16-45c8-4d4d-ba56-5db625c69e89 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1510 microversion: 2.1 time: 0.123157 Oct 30 01:10:17.755618 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 64/134] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:17 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1510 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:18.345772 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:18.347416 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:18.362453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:18.370457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:18.370457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:18.370457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:18.370457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:18.371050 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:18.708277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:18.728202 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b31d338b-cf2a-4d36-8255-ec7500514e3d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.397812 Oct 30 01:10:18.729502 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 71/135] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:18 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:18.784436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:18.785357 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:18.811479 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:18.812616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:18.816531 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:18.817754 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:18.818534 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:18.819239 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:19.090100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:19.094995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:19.110352 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e6c19c84-01fd-48f7-ba7b-c1113cc83146 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1345 microversion: 2.1 time: 0.332840 Oct 30 01:10:19.123401 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 65/136] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:18 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1345 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:19.781496 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:19.783529 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:19.792699 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:19.795885 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:19.798724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:19.798724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:19.800066 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:19.801129 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:20.038740 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:20.046639 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-59d0efde-5b06-4787-9064-3039561ee656 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.270169 Oct 30 01:10:20.047968 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 72/137] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:19 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:20.161915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:20.163083 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:20.166455 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:20.175870 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:20.176366 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:20.177946 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:20.178624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:20.179991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:20.180684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:20.236221 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:20.236909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:20.237571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:20.238222 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lazy-loading 'fault' on Instance uuid d6eded78-b511-4e4a-a62d-320226461b59 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:10:20.314358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12208f0ceb41c8bb3b69cbd62e78b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445041c33bf944d8a7a39281e3aba6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:20.327287 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-cdda5ce7-064b-4f6c-a6d9-2fcbd5155df8 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 200 len: 1350 microversion: 2.1 time: 0.171747 Oct 30 01:10:20.328337 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 66/138] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:20 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 1350 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:21.083696 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:21.086057 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:21.120144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:21.120144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:21.120144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:21.120144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:21.120511 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:21.120511 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:21.355276 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:21.365150 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0bf3c9a6-8e57-441e-b8b6-917bc64ba540 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.286294 Oct 30 01:10:21.372307 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 73/139] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:21 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:21.372543 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:21.372543 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:21.386353 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:21.387152 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:21.387981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:21.389323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:21.390155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:21.390944 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:21.409564 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] HTTP exception thrown: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Request method failure captured: Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 HTTP/1.1 Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc7DbBJOSXGeCbqFj2zd-B0UvFF0Uw3jJ_ed573uHarNRNy5XOlc3XUMAKYC8GH029fG5lqmAES_C9WGr62dxNx2jw9A_4ih9HXqkr_xSH51p10SToqWtDuVmUqdrmE6GgVYG8pmwUX50ddv4QXdViLE4AnCnXZs4Kol3V3g2tGXZsI Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:10:21.419195 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 3e12208f0ceb41c8bb3b69cbd62e78b2 Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:21.421537 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'd6eded78-b511-4e4a-a62d-320226461b59'} Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:10:21.423121 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:21.425948 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:21.427030 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Returning 404 to user: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:10:21.427030 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-cf7e8a4f-10a2-43d6-b2d5-bc0ce07a900b tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 404 len: 111 microversion: 2.1 time: 0.054965 Oct 30 01:10:21.427030 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 67/140] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:21 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:10:22.005678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:22.005678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:22.008227 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:22.008812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:22.009575 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:22.010362 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:22.011010 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:22.011467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:22.029525 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] HTTP exception thrown: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Request method failure captured: Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59/os-volume_attachments HTTP/1.1 Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc7DbBJOSXGeCbqFj2zd-B0UvFF0Uw3jJ_ed573uHarNRNy5XOlc3XUMAKYC8GH029fG5lqmAES_C9WGr62dxNx2jw9A_4ih9HXqkr_xSH51p10SToqWtDuVmUqdrmE6GgVYG8pmwUX50ddv4QXdViLE4AnCnXZs4Kol3V3g2tGXZsI Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:10:22.034468 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 3e12208f0ceb41c8bb3b69cbd62e78b2 Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:22.037288 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'server_id': 'd6eded78-b511-4e4a-a62d-320226461b59'} Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:10:22.039527 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:22.041676 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:22.044136 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Returning 404 to user: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:10:22.044136 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-23d54859-1198-4c2f-9b4f-9c08b920967a tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049467 Oct 30 01:10:22.044136 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 74/141] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:10:21 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:10:22.408687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:22.410713 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:22.419231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:22.420164 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:22.420892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:22.422098 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:22.433497 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:22.434121 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:22.604553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:22.621639 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d15228b3-1afc-4ba9-8cac-b3eff7325966 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.218158 Oct 30 01:10:22.622871 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 68/142] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:22 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:23.651991 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:23.653191 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:23.665473 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:23.666213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:23.666867 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:23.668090 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:23.668705 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:23.670095 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:23.896428 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:23.908673 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-dfe258cf-58ba-4c8c-9a0d-10e31c02e64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.264834 Oct 30 01:10:23.912043 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 75/143] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:23 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:24.943729 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:24.944625 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:24.951689 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:24.952306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:24.952744 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:24.953458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:24.953915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:24.954342 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:25.161521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:25.162360 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:25.178915 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=60 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:25.179624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:25.182690 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:25.184004 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:25.185479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:25.187147 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:25.189531 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:25.190654 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:25.196277 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b5dec5d4-13ff-4fc2-9476-57f84265d6fa tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.256244 Oct 30 01:10:25.197377 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 69/144] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:24 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:25.220611 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] HTTP exception thrown: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Request method failure captured: Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: DELETE /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 HTTP/1.1 Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc7DbBJOSXGeCbqFj2zd-B0UvFF0Uw3jJ_ed573uHarNRNy5XOlc3XUMAKYC8GH029fG5lqmAES_C9WGr62dxNx2jw9A_4ih9HXqkr_xSH51p10SToqWtDuVmUqdrmE6GgVYG8pmwUX50ddv4QXdViLE4AnCnXZs4Kol3V3g2tGXZsI Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:10:25.223846 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 3e12208f0ceb41c8bb3b69cbd62e78b2 Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.225256 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'd6eded78-b511-4e4a-a62d-320226461b59'} Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:10:25.226281 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.227489 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.231546 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Returning 404 to user: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:10:25.232680 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ac372ce4-f325-4cdd-91dc-c690c43d5ff5 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 404 len: 111 microversion: 2.1 time: 0.082599 Oct 30 01:10:25.233456 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 76/145] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:10:25 2022] DELETE /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:10:25.242322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:25.242977 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] [instance: d6eded78-b511-4e4a-a62d-320226461b59] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:25.250102 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:25.250659 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:25.251646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:25.252451 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:25.253145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:25.253670 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:25.269901 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] HTTP exception thrown: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Request method failure captured: Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 HTTP/1.1 Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc7DbBJOSXGeCbqFj2zd-B0UvFF0Uw3jJ_ed573uHarNRNy5XOlc3XUMAKYC8GH029fG5lqmAES_C9WGr62dxNx2jw9A_4ih9HXqkr_xSH51p10SToqWtDuVmUqdrmE6GgVYG8pmwUX50ddv4QXdViLE4AnCnXZs4Kol3V3g2tGXZsI Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:10:25.271470 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/445041c33bf944d8a7a39281e3aba6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 445041c33bf944d8a7a39281e3aba6c5 Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-DeleteServersTestJSON-2114815047 Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 3e12208f0ceb41c8bb3b69cbd62e78b2 Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-DeleteServersTestJSON-2114815047-project Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.273601 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'd6eded78-b511-4e4a-a62d-320226461b59'} Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:10:25.274252 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. Oct 30 01:10:25.275275 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:10:25.276253 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] Returning 404 to user: Instance d6eded78-b511-4e4a-a62d-320226461b59 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:10:25.276253 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-15d20aa3-c323-4906-be81-642e8fa516b0 tempest-DeleteServersTestJSON-2114815047 tempest-DeleteServersTestJSON-2114815047-project] 10.222.0.26 "GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59" status: 404 len: 111 microversion: 2.1 time: 0.035630 Oct 30 01:10:25.276253 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 70/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:25 2022] GET /compute/v2.1/servers/d6eded78-b511-4e4a-a62d-320226461b59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:10:26.239219 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:26.240248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:26.246855 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:26.247335 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:26.247980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:26.249181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:26.249793 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:26.250455 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:26.482716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:26.486926 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-45308ac5-c73b-465c-89a7-4750f3d7b41c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.252102 Oct 30 01:10:26.488556 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 77/147] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:26 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:27.511876 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:27.512695 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:27.520452 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:27.521233 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:27.521681 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:27.522594 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:27.523065 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:27.523498 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:27.710764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:27.723658 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-315d29c1-7c0b-48d5-b27a-7d853584d245 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.215986 Oct 30 01:10:27.724296 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 71/148] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:27 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:28.753571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:28.754736 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:28.767266 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:28.768478 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:28.769298 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:28.770598 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:28.771767 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:28.772381 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:29.033702 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:29.035526 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5f717303-09b0-407b-b7fa-e44c61b78f0d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.290277 Oct 30 01:10:29.037040 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 78/149] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:28 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:30.071275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:30.082916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:30.099142 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:30.099766 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:30.100448 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:30.101666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:30.102437 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:30.103101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:30.440010 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:30.461220 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-cca556c7-2dce-4b55-a52d-bfa6fb7ca146 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.397947 Oct 30 01:10:30.464079 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 72/150] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:30 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:31.496563 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:31.498719 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:31.523485 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:31.524154 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:31.529054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:31.530327 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:31.531034 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:31.531854 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:31.815545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:31.828812 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d20f2fc5-bb4f-4ef0-af79-805c0804fd96 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.344446 Oct 30 01:10:31.829866 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 79/151] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:31 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:32.863656 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:32.864268 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:32.879427 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:32.880838 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:32.882266 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:32.883136 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:32.884008 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:32.884899 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:33.126194 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:33.142283 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-28645c79-512a-4a80-b8e5-c960e0e0bca7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.283143 Oct 30 01:10:33.143775 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 73/152] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:32 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:34.174725 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:34.175853 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:34.188010 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:34.189081 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:34.189807 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:34.191094 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:34.191911 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:34.192694 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:34.513032 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:34.543313 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1e85e02f-7a56-4032-aa5d-e5702e5de8c9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.375508 Oct 30 01:10:34.547359 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 80/153] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:34 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:35.581043 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:35.581889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:35.590086 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:35.590634 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:35.591323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:35.592289 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:35.592798 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:35.593303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:35.798869 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:35.808206 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8b5f1f85-6a88-4411-872d-d4be4bc2a870 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1520 microversion: 2.1 time: 0.231089 Oct 30 01:10:35.809019 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:35 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:36.836322 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:36.837174 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:36.844175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:36.845138 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:36.845872 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:36.846971 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:36.847497 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:36.848423 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:37.136814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:37.168155 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e9491876-af40-4474-a1a8-2a7b1c2555ca tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1500 microversion: 2.1 time: 0.335925 Oct 30 01:10:37.169751 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 81/155] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:36 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1500 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:37.192498 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:37.194925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:37.202651 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:37.203513 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:37.204199 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:37.205721 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:37.206485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:37.207161 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:37.424167 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:37.437939 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-113cacc3-e768-4b0f-9e6c-84273999570e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1516 microversion: 2.1 time: 0.248867 Oct 30 01:10:37.439359 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 75/156] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:37 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:39.907037 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:39.912184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:39.922850 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:39.923366 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:39.923856 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:39.924571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:39.925027 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:39.925443 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:39.952428 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'flavor' on Instance uuid 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:10:40.313808 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fe784ad9-9c8c-42ee-bf0f-4747296faf57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8/action" status: 200 len: 32 microversion: 2.1 time: 0.413803 Oct 30 01:10:40.314601 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 82/157] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:10:39 2022] POST /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:10:40.336004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:40.336004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:40.342426 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:40.343567 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:40.344405 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:40.345648 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:40.346598 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:40.347217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:40.564752 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:40.581140 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5f790a2a-4a99-4115-9605-28366c0d0104 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.258534 Oct 30 01:10:40.582552 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 76/158] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:40 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:41.609965 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:41.611189 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:41.622155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:41.623237 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:41.624025 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:41.625073 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:41.625795 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:41.626403 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:41.857481 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:41.879409 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ea6927b0-3ebd-43a4-86af-2344743186f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.274282 Oct 30 01:10:41.882403 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 83/159] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:41 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:42.905561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:42.906343 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:42.913547 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:42.914046 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:42.914472 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:42.915353 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:42.916064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:42.916491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:43.236380 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:43.252481 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-731e12c2-dfe1-486d-9f3d-1bfe308caf2f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.350341 Oct 30 01:10:43.254293 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 77/160] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:42 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:44.292204 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:44.293379 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:44.302112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:44.303294 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:44.303930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:44.304816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:44.305572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:44.306387 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:44.334072 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:44.535618 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:44.546323 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9522ab96-4669-4a35-a9f6-169de854c060 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.259911 Oct 30 01:10:44.547344 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 84/161] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:44 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:45.578763 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:45.579561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:45.596513 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:45.598436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:45.598436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:45.608259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:45.612098 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:45.613115 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:45.998542 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:46.014056 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-362df1a6-cb02-4719-bd69-52180fffa48e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.439789 Oct 30 01:10:46.015299 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 78/162] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:45 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:47.059017 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:47.060121 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:47.074720 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:47.075520 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:47.076262 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:47.077757 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:47.078540 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:47.079480 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:47.274581 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:47.287834 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7bf82d0a-202d-4147-9a43-48e8a2c8a9ed tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.233263 Oct 30 01:10:47.288986 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 85/163] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:47 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:48.319074 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:48.320086 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:48.330716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:48.331927 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:48.332927 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:48.334750 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:48.335537 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:48.336291 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:48.497199 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2068833275", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "networks": [{"uuid": "9dfe5552-55fb-47a8-85eb-9baab719c343"}]}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:48.606914 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] validate_networks() for [('9dfe5552-55fb-47a8-85eb-9baab719c343', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:10:48.690236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:48.724916 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-106d454d-5d7f-44cb-a649-4eb179e50414 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.413431 Oct 30 01:10:48.727212 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 79/164] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:48 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:49.197941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:10:49.198367 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:10:49.198874 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:10:49.199281 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:10:49.199757 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:10:49.209088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:49.211277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:49.211277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:49.211277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:49.211277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:49.211685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:49.229390 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Getting quotas for project b3ac92b862ae4d988409b01c3adfef75. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:10:49.233864 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Getting quotas for user 19714f6672d345a38370effe826a3d2a and project b3ac92b862ae4d988409b01c3adfef75. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:10:49.246966 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:10:49.249620 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:10:49.491875 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6f8e8a57-0a28-4d5d-b00f-c94523b51840 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001759 Oct 30 01:10:49.492550 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 86/165] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:10:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:10:49.505006 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5215d06c-1cf9-4a89-93b1-78ced931f121 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:49.506490 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-5215d06c-1cf9-4a89-93b1-78ced931f121 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:49.585933 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-5215d06c-1cf9-4a89-93b1-78ced931f121 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:49.601906 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5215d06c-1cf9-4a89-93b1-78ced931f121 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1214 microversion: 2.1 time: 0.100640 Oct 30 01:10:49.602838 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 80/166] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:49 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:49.764273 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:49.765373 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:49.777744 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:49.778710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:49.779441 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:49.780386 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:49.781079 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:49.781582 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:49.941300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:49.950659 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-eba8670e-9ad5-478b-9cb2-5fb1987c66f2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.193820 Oct 30 01:10:49.951261 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 87/167] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:49 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:50.382999 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:50.382999 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:50.399942 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:50.399942 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:50.399942 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:50.399942 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:50.400549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:50.400549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:50.447008 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d4295154-3d10-4f66-ae73-39fe33430a0c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/ips" status: 200 len: 147 microversion: 2.1 time: 0.073961 Oct 30 01:10:50.448060 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 81/168] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:10:50 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/ips => generated 147 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:50.628489 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-58cc3fb4-e597-4bc6-8586-e1ec27ec329e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:50.629161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-58cc3fb4-e597-4bc6-8586-e1ec27ec329e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:50.738135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-58cc3fb4-e597-4bc6-8586-e1ec27ec329e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:50.756762 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-58cc3fb4-e597-4bc6-8586-e1ec27ec329e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1214 microversion: 2.1 time: 0.132512 Oct 30 01:10:50.758794 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 88/169] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:50 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:50.977804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:50.979348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:50.987077 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:50.987744 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:50.988178 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:50.989331 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:50.989806 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:50.990469 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:51.190985 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:51.201700 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3a82cf94-137c-4626-a9ae-64836338d84c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.228865 Oct 30 01:10:51.206620 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 82/170] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:50 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:51.788666 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:51.789506 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:51.798004 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:51.798993 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:51.799907 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:51.800953 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:51.801899 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:51.803171 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:51.901354 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:51.913042 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b5e460a9-042b-4bf6-a01c-30d3b4a020be tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1218 microversion: 2.1 time: 0.133782 Oct 30 01:10:51.914072 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 89/171] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:51 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:52.227454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:52.229471 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:52.235029 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:52.235680 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:52.236122 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:52.236828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:52.237280 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:52.237858 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:52.398192 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:52.407237 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9151c2aa-da2c-45fd-825b-ecbcaa785e5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.184584 Oct 30 01:10:52.407918 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 83/172] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:52 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:52.956150 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:52.959223 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:52.968043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:52.968999 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:52.969574 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:52.970632 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:52.971293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:52.972020 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:53.099044 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:53.110478 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6fbc8fdf-ccf6-4484-9d55-c15fdcfd4715 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1266 microversion: 2.1 time: 0.162533 Oct 30 01:10:53.111731 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 90/173] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:52 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:53.448252 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:53.449188 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:53.451788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=40 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:53.462099 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:53.462678 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:53.463121 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:53.463871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:53.464336 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:53.464764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:53.467932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=96 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:53.693892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:53.705208 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0780ee8f-842e-452d-993c-9e7f42f86891 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.261273 Oct 30 01:10:53.706315 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 84/174] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:53 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:54.152428 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:54.153726 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:54.164289 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:54.165508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:54.166444 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:54.168106 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:54.169133 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:54.170096 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:54.282654 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb9ad45f-a2e1-4364-9dad-2f3275858bc2"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:54.285513 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:54.305948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:54.306812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:54.307564 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:54.308390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:54.308971 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:54.309653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:54.312669 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:54.330157 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ca4b4068-e31a-4b7d-ad0e-95d1f42ff4c5 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1266 microversion: 2.1 time: 0.178725 Oct 30 01:10:54.330157 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 91/175] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:54 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:54.748931 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:54.749940 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:54.769495 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:54.772830 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:54.773651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:54.774559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:54.777060 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:54.777642 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:55.226833 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:55.238258 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b4268554-3148-41ec-92f4-21d790e3a856 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1502 microversion: 2.1 time: 0.497833 Oct 30 01:10:55.239157 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 92/176] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:54 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1502 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:55.280565 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "103e779e-8f62-4328-be39-771d81e8440c"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:55.285813 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:55.298451 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:55.299127 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:55.300007 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:55.301258 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:55.303022 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:55.303841 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:55.335806 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] HTTP exception thrown: Cannot 'attach_volume' instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 while it is in vm_state rescued Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Request method failure captured: Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: POST /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8/os-volume_attachments HTTP/1.1 Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 74 Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc69huK0SDLXJgmIyu6BPqSYLCVEyIe9cHnN98C6O0bg_C7P_g7RJWF5daFRmnsRL19ij5JAK_vjEApIvbFGQlCjV-KCkLe9-zN-5krIMF7R5TTcyZppp7pWvZDYocAh55uvA4MKS4HDcGpFMmPnKZahm2375jZeXhgkqsq8CtjGUsI Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:10:55.338692 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: a4a4230574c846a9b4f7edd240317ee9 Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: {"volumeAttachment": {"volumeId": "103e779e-8f62-4328-be39-771d81e8440c"}} Oct 30 01:10:55.341464 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Cannot 'attach_volume' instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 while it is in vm_state rescued Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'server_id': '89eececf-ad51-4cbd-832b-a2f9d5a6dca8', 'body': {'volumeAttachment': {'volumeId': '103e779e-8f62-4328-be39-771d81e8440c'}}} Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:10:55.343255 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 while it is in vm_state rescued Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:55.345857 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:55.349039 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:10:55.349039 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:10:55.349039 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 while it is in vm_state rescued Oct 30 01:10:55.349039 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:10:55.349039 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Returning 409 to user: Cannot 'attach_volume' instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 while it is in vm_state rescued {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:10:55.349039 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-eda91696-96d9-4fef-91fe-3d2229c327a5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066990 Oct 30 01:10:55.349039 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 93/177] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:10:55 2022] POST /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:10:55.356018 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:55.356737 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:55.366267 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:55.370261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:55.370261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:55.370261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:55.370261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:55.371048 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:55.727092 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d432edc8-bddd-44f1-b877-c1a1f9ff9b73 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8/action" status: 202 len: 0 microversion: 2.1 time: 0.376897 Oct 30 01:10:55.728583 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 94/178] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:10:55 2022] POST /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:10:55.745085 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:55.745882 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:55.752947 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:55.753447 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:55.753991 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:55.754739 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:55.755200 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:55.755777 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:55.999133 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:56.008771 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8b8961d6-74b9-47a3-b92c-15cd233f8c9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.278011 Oct 30 01:10:56.009367 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 95/179] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:55 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:56.015698 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:56.016360 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:56.035539 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:56.036113 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:56.036564 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:56.037599 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:56.038073 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:56.038497 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:56.291233 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7dd2d24b-a291-411e-88a8-418c0e6f4a95 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.018625 Oct 30 01:10:56.293009 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 85/180] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:10:54 2022] POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-volume_attachments => generated 194 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:56.361773 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:56.383349 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1316c347-d3e0-4168-b896-e7f005255f8c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1510 microversion: 2.1 time: 0.371119 Oct 30 01:10:56.384893 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 96/181] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:56 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:57.061902 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:57.062601 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:57.070332 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:57.071116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:57.071560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:57.072336 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:57.077450 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:57.077450 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:57.250715 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-60f92796-d64c-4281-a32f-41cf0a3d0060 req-0c34472a-ed23-4d78-be8d-c5a22905e364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30298691-7c9f-46a5-bfe7-02e32ff5fbaf", "tag": "b88d5b1b-4439-446e-9c93-18c9d40b60a7"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:57.255055 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:57.261004 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:57.266694 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4ed65f52-88b3-4271-ad73-26232c6b7c8f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.209489 Oct 30 01:10:57.267451 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 86/182] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:57 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:57.269262 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-60f92796-d64c-4281-a32f-41cf0a3d0060 req-0c34472a-ed23-4d78-be8d-c5a22905e364 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:57.270302 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-60f92796-d64c-4281-a32f-41cf0a3d0060 req-0c34472a-ed23-4d78-be8d-c5a22905e364 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:57.271986 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-60f92796-d64c-4281-a32f-41cf0a3d0060 req-0c34472a-ed23-4d78-be8d-c5a22905e364 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:57.296524 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-60f92796-d64c-4281-a32f-41cf0a3d0060 req-0c34472a-ed23-4d78-be8d-c5a22905e364 service nova] Creating event network-changed:b88d5b1b-4439-446e-9c93-18c9d40b60a7 for instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf on hv-cinder-maste Oct 30 01:10:57.305174 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-60f92796-d64c-4281-a32f-41cf0a3d0060 req-0c34472a-ed23-4d78-be8d-c5a22905e364 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062178 Oct 30 01:10:57.306899 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 97/183] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:10:57.428853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:57.430018 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:57.459324 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:57.459980 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:57.460436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:57.461200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:57.461670 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:57.488983 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:57.713005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:57.722698 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2d382403-fd90-4370-9a7c-1d083d3bbf36 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1510 microversion: 2.1 time: 0.301992 Oct 30 01:10:57.730196 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 87/184] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:57 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:58.304377 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:58.306907 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:58.320146 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:58.321051 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:58.322173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:58.339954 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:58.339954 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:58.339954 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:58.610772 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:58.622952 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8bf6bd01-95e6-4893-8055-d02d727040ff tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.326976 Oct 30 01:10:58.623781 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 98/185] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:58 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:58.754557 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:58.756281 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:58.765223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:58.766090 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:58.767021 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:58.768145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:58.769146 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:58.769784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:59.051339 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:59.072009 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-76249f4f-8edb-477c-904c-14c3557bf94d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1510 microversion: 2.1 time: 0.321393 Oct 30 01:10:59.073075 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 88/186] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:58 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:59.668344 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:59.670212 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:59.679619 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:59.682107 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:59.683629 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:59.684574 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:59.685952 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:59.688627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:59.690257 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:00.058416 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:00.080979 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e8ebabfc-f870-445c-98ab-d084124c0da3 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.417173 Oct 30 01:11:00.081797 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 99/187] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:59 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:00.101884 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:00.102741 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:00.110121 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:00.112953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:00.113526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:00.114393 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:00.115844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:00.116465 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:00.117115 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:00.310619 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:00.321552 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8059985d-e0d7-4626-8ed7-038a744212f4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1516 microversion: 2.1 time: 0.225545 Oct 30 01:11:00.323221 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 89/188] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:00 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:00.982520 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e725a971-aae0-40c0-8bbf-e67c26d78f27 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:01.004104 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=8 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:01.008544 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e725a971-aae0-40c0-8bbf-e67c26d78f27 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.009981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e725a971-aae0-40c0-8bbf-e67c26d78f27 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.011112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e725a971-aae0-40c0-8bbf-e67c26d78f27 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.118246 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:01.119518 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:01.139381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.140444 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.141642 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.143071 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.144055 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.145155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.163971 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e725a971-aae0-40c0-8bbf-e67c26d78f27 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Going to try to stop instance {{(pid=119523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:11:01.473222 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e725a971-aae0-40c0-8bbf-e67c26d78f27 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action" status: 202 len: 0 microversion: 2.1 time: 0.497363 Oct 30 01:11:01.474832 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 100/189] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:11:00 2022] POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:11:01.486430 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:01.487260 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:01.495007 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.495871 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.496112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.496911 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.497633 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.498054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.550835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:01.570542 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2b943be1-87b4-4ce6-a85f-52530888bc9a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.465695 Oct 30 01:11:01.572014 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 90/190] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:01 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:01.803090 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:01.810930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:01.822505 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-aab994f3-79fa-4d65-be3e-fe75f8c0c683 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.343153 Oct 30 01:11:01.823361 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 101/191] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:01 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:02.324727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e3279ff7-ebbb-4fb7-a5c6-bfc4fbf38367 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'create', calling method: .version_select at 0x7f048c0cbf70>, body: {"keypair": {"name": "tempest-keypair-17187436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5tu6J0c7NGD5hEN6IauK3zUcx9jrt8zJInW7JfFH4vJkSvM/el6uMWcB+iHQl6ffrnajWk+CltOWNF9WJWKNxn4Y/B65DqJrzH66fLHDLd1D3OcZKQN32oE9UWRgIXnQ=="}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:02.367386 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-e3279ff7-ebbb-4fb7-a5c6-bfc4fbf38367 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for project 95c63194a18f4768abe23f55608ec8c6. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:11:02.377347 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-e3279ff7-ebbb-4fb7-a5c6-bfc4fbf38367 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for user a4a4230574c846a9b4f7edd240317ee9 and project 95c63194a18f4768abe23f55608ec8c6. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:11:02.554220 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e3279ff7-ebbb-4fb7-a5c6-bfc4fbf38367 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.234892 Oct 30 01:11:02.562285 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 91/192] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:11:02 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:02.613519 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:02.614155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:02.622981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:02.623856 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:02.624593 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:02.625809 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:02.626479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:02.627143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:02.854348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:02.856240 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:02.868906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:02.869541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:02.870718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:02.871928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:02.873815 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:02.874989 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:02.876152 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:02.890968 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c1f1de5b-75ca-4046-bfb6-45b31841eb78 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.279736 Oct 30 01:11:02.896671 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 102/193] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:02 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:03.184754 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:03.195519 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-66c5465d-3d5b-4f22-8e05-deba7770e31b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.349889 Oct 30 01:11:03.196403 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 92/194] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:02 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:03.931543 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:03.932396 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:03.950596 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:03.951125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:03.951562 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:03.952305 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:03.959097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:03.959097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:04.222354 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:04.235321 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fc6e86e9-00b3-448c-8e6e-4ce3a14a338d tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.310354 Oct 30 01:11:04.236456 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 103/195] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:03 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:04.237830 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:04.245198 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:04.259202 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:04.260155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:04.260969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:04.262306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:04.263160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:04.264317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:04.493585 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:04.520911 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-260d656c-c48c-4e6b-8989-3c885581e343 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.289634 Oct 30 01:11:04.539678 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 93/196] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:04 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:05.276401 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:05.277483 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:05.300178 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:05.301586 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:05.303042 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:05.307163 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:05.308065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:05.309157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:05.552049 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:05.553440 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:05.560113 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:05.568637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:05.570024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:05.571285 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:05.573009 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:05.574300 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:05.575322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:05.578317 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a4c1f6d2-e6b7-4870-8931-f69c54bab335 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.307781 Oct 30 01:11:05.579454 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 104/197] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:05 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:05.881986 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:05.897606 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b8b53060-592b-42cd-a1ff-e7719c88ccbe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.353792 Oct 30 01:11:05.898450 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 94/198] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:05 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:06.050016 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-19559ce9-0270-4447-96c0-b68e5b67fe82 req-38a5889f-8dea-46cf-9165-7e8fbed4dced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30298691-7c9f-46a5-bfe7-02e32ff5fbaf", "name": "network-vif-plugged", "status": "completed", "tag": "b88d5b1b-4439-446e-9c93-18c9d40b60a7"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:06.061262 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-19559ce9-0270-4447-96c0-b68e5b67fe82 req-38a5889f-8dea-46cf-9165-7e8fbed4dced service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:06.061753 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-19559ce9-0270-4447-96c0-b68e5b67fe82 req-38a5889f-8dea-46cf-9165-7e8fbed4dced service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:06.062186 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-19559ce9-0270-4447-96c0-b68e5b67fe82 req-38a5889f-8dea-46cf-9165-7e8fbed4dced service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:06.077206 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-19559ce9-0270-4447-96c0-b68e5b67fe82 req-38a5889f-8dea-46cf-9165-7e8fbed4dced service nova] Creating event network-vif-plugged:b88d5b1b-4439-446e-9c93-18c9d40b60a7 for instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf on hv-cinder-maste Oct 30 01:11:06.083166 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-19559ce9-0270-4447-96c0-b68e5b67fe82 req-38a5889f-8dea-46cf-9165-7e8fbed4dced service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038871 Oct 30 01:11:06.084301 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 105/199] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:06.627799 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:06.629059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:06.641475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:06.643029 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:06.643802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:06.649068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:06.649068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:06.649068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:06.825479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-345314323", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de618076-b93d-46d5-a096-a44e39256fff"}], "security_groups": [{"name": "tempest-securitygroup--126404444"}], "key_name": "tempest-keypair-17187436", "user_data": "}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:06.935811 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:06.938961 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4d30beb9-829a-462c-8087-7cdd5707dc45 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.320457 Oct 30 01:11:06.946466 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 95/200] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:06 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:06.951529 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:06.952179 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:06.961066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:06.961555 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:06.961992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:06.962919 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:06.963372 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:06.963859 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:07.010070 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] validate_networks() for [('de618076-b93d-46d5-a096-a44e39256fff', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:11:07.269554 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:07.288190 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fc72f76c-f934-4f02-bd8b-9264db6f073c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.340136 Oct 30 01:11:07.289259 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 96/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:06 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:07.664460 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:11:07.665250 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:11:07.666187 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:11:07.666961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:11:07.667956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:11:07.685238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:07.685978 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:07.687122 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:07.695286 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:07.696610 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:07.697796 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:07.747895 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for project 95c63194a18f4768abe23f55608ec8c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:11:07.755067 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Getting quotas for user a4a4230574c846a9b4f7edd240317ee9 and project 95c63194a18f4768abe23f55608ec8c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:11:07.775762 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:11:07.780669 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:11:07.965067 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:07.965755 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:07.979061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:07.979675 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:07.980121 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:07.981657 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:07.982080 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:07.982515 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:08.016676 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-31e52b32-755b-403d-956d-95b6c9c8640f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.201410 Oct 30 01:11:08.024886 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 106/202] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:11:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:11:08.036338 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7c2ab645-aa9f-4015-b5ac-53dff4ae0c46 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:08.037353 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7c2ab645-aa9f-4015-b5ac-53dff4ae0c46 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:08.184585 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7c2ab645-aa9f-4015-b5ac-53dff4ae0c46 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:08.193875 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7c2ab645-aa9f-4015-b5ac-53dff4ae0c46 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1243 microversion: 2.1 time: 0.166866 Oct 30 01:11:08.195078 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 107/203] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:08 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1243 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:08.322606 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:08.323224 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:08.337878 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:08.344358 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:08.344914 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:08.345682 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:08.352745 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:08.353202 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:08.528657 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:08.538069 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d61ed5d6-a061-42bb-be50-a3b87159f1ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1314 microversion: 2.1 time: 0.578019 Oct 30 01:11:08.539049 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 97/204] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:07 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:08.577219 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:08.585850 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c2b4e64e-5d35-4235-b36b-73ce2f5c8eb5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.267227 Oct 30 01:11:08.586426 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 108/205] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:08 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:09.227108 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d08aeb52-9230-49c4-8e9d-84e3d047b64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:09.227108 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d08aeb52-9230-49c4-8e9d-84e3d047b64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:09.300247 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d08aeb52-9230-49c4-8e9d-84e3d047b64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:09.313891 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d08aeb52-9230-49c4-8e9d-84e3d047b64f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1243 microversion: 2.1 time: 0.095052 Oct 30 01:11:09.315335 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 98/206] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:09 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1243 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:09.565000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:09.565587 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:09.573634 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:09.574454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:09.574952 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:09.575719 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:09.576181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:09.576618 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:09.616550 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:09.618381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:09.630999 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:09.632198 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:09.633393 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:09.640307 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:09.649751 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:09.652930 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:09.845259 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:09.860543 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6dabdfe3-1fdf-4a16-a883-22d6e5b86670 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1499 microversion: 2.1 time: 0.302250 Oct 30 01:11:09.862460 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 109/207] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:09 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1499 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:09.967989 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:09.984477 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-094aaf14-ec72-4dff-9d7b-6f73104bb280 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.376307 Oct 30 01:11:09.985524 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 99/208] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:09 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:10.342404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:10.343518 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:10.353538 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:10.355956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:10.357187 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:10.358762 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:10.359849 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:10.360826 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:10.486006 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:10.500253 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-df0ee725-db9e-40cc-b366-6e30e40c9b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1247 microversion: 2.1 time: 0.162970 Oct 30 01:11:10.519793 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 110/209] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:10 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1247 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:11.020908 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:11.024816 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:11.037890 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.039076 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.044878 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.044878 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.044878 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.044878 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.313776 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:11.327509 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c2c98013-6503-4fc0-acbb-856f12fda2f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.317937 Oct 30 01:11:11.328334 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 100/210] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:11 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:11.554339 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:11.555603 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:11.564932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:11.565495 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:11.567140 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.568644 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.570155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.571541 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.572381 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.573397 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.573530 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.573900 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.574378 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.575098 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.575560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.576099 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.603469 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:11.621812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:11:11.664330 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:11.675550 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e0a0fbf2-0f35-499e-baf2-d0994032c778 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1239 microversion: 2.1 time: 0.128808 Oct 30 01:11:11.676496 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 111/211] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:11 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1239 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:12.040747 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9679c10d-a1a5-4d0c-8124-171d1b60f901 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 204 len: 0 microversion: 2.1 time: 0.479607 Oct 30 01:11:12.041766 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 101/212] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:11:11 2022] DELETE /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:11:12.060183 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:12.061230 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:12.093226 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:12.094207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:12.094861 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:12.096238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:12.096981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:12.104804 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:12.305309 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:12.313850 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-56ba27e5-5a4b-4b1a-98b1-123b6d017e0c tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1505 microversion: 2.1 time: 0.266578 Oct 30 01:11:12.314448 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 112/213] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:12 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:12.378263 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:12.379061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:12.389069 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:12.390175 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:12.390998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:12.392766 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:12.393569 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:12.394290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:12.625409 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:12.642795 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1d1cd02b-23e0-4e6f-9212-d893ac0c3424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.268937 Oct 30 01:11:12.644359 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 102/214] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:12 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:12.703222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:12.704112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:12.722034 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:12.723342 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:12.724918 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:12.726823 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:12.728155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:12.729239 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:12.845900 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:12.860538 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-dc8d19db-f715-45a0-b26e-48564279e4b6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1295 microversion: 2.1 time: 0.161714 Oct 30 01:11:12.861319 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 113/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:12 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:13.339071 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:13.341574 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:13.360397 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.361609 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.363286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:13.364117 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.365123 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.365541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:13.590219 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:13.618910 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f3def521-bfeb-49ae-8a62-044d389378ae tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1505 microversion: 2.1 time: 0.283477 Oct 30 01:11:13.651874 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 103/216] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:13 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:13.682894 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:13.685022 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:13.707518 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.709085 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.709614 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:13.710526 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.711311 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.711878 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:13.891041 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:13.891525 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:13.933502 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.934430 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.935260 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:13.943387 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.944544 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.948044 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:14.105246 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:14.114521 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-56f05e0a-c25a-4dfe-b853-041d0abaa5c1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1295 microversion: 2.1 time: 0.229176 Oct 30 01:11:14.115490 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 104/217] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:13 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1295 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:14.118257 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:14.138808 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9b267ebd-18b8-4567-8027-c8b94fb1c02e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.467531 Oct 30 01:11:14.141045 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 114/218] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:13 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:14.670181 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:14.672021 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:14.681687 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-a5d22f2e-5239-4230-baa7-01a02677e7c4 req-9ff6063a-8d43-4ca1-9154-9bdc93afad6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30298691-7c9f-46a5-bfe7-02e32ff5fbaf", "name": "network-vif-deleted", "tag": "b88d5b1b-4439-446e-9c93-18c9d40b60a7"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:14.694604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a5d22f2e-5239-4230-baa7-01a02677e7c4 req-9ff6063a-8d43-4ca1-9154-9bdc93afad6b service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:14.695096 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a5d22f2e-5239-4230-baa7-01a02677e7c4 req-9ff6063a-8d43-4ca1-9154-9bdc93afad6b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:14.695532 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a5d22f2e-5239-4230-baa7-01a02677e7c4 req-9ff6063a-8d43-4ca1-9154-9bdc93afad6b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:14.704988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:14.706835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:14.708913 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:14.710901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:14.712055 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:14.712504 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-a5d22f2e-5239-4230-baa7-01a02677e7c4 req-9ff6063a-8d43-4ca1-9154-9bdc93afad6b service nova] Creating event network-vif-deleted:b88d5b1b-4439-446e-9c93-18c9d40b60a7 for instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf on hv-cinder-maste Oct 30 01:11:14.714735 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:14.725673 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-a5d22f2e-5239-4230-baa7-01a02677e7c4 req-9ff6063a-8d43-4ca1-9154-9bdc93afad6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046923 Oct 30 01:11:14.725673 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 115/219] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:14.883637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:14.906839 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3a81e29e-2434-4ec5-a666-8c171a816992 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1463 microversion: 2.1 time: 0.242802 Oct 30 01:11:14.908549 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 105/220] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:14 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:15.172734 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:15.174628 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:15.179884 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:15.180847 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:15.190801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.192815 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.194006 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:15.198969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.198969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.198969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:15.199527 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.199716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.199874 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.200059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.200222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:15.200383 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:15.368846 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:15.402414 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fa6f7b9a-b2c4-4e11-a054-c4cda188544d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1303 microversion: 2.1 time: 0.244394 Oct 30 01:11:15.416035 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 116/221] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:15 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:15.602498 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:15.627625 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6196a432-eca1-4d9e-8c6e-b309c9333ce1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.452162 Oct 30 01:11:15.629690 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 106/222] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:15 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:15.953704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:15.958432 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:15.974046 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.974539 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.975077 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:15.982213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.987742 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.988515 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.038192 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.038957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.039426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.040054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lazy-loading 'fault' on Instance uuid 30298691-7c9f-46a5-bfe7-02e32ff5fbaf {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:11:16.107050 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:16.143271 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7ec1a473-2d70-44fe-80e7-0d006ef48156 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 200 len: 1304 microversion: 2.1 time: 0.195570 Oct 30 01:11:16.143905 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 117/223] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:15 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 1304 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:16.446462 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:16.447460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:16.462007 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.462870 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.463650 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.464888 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.465713 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.468451 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.625399 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:16.649136 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-24f82469-ea50-4c51-864d-100a98153fcd tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1301 microversion: 2.1 time: 0.206944 Oct 30 01:11:16.651797 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 107/224] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:16 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1301 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:16.685967 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:16.687089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:16.708728 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.717368 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.727633 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.729424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.731970 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.733200 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:17.197436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:17.198526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 30298691-7c9f-46a5-bfe7-02e32ff5fbaf] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:17.242604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:17.243908 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:17.253506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:17.253506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:17.253506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:17.253506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:17.254431 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:17.279908 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6d33fb48-09d4-4e3d-b83a-84e71630cfc5 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1724 microversion: 2.1 time: 0.611119 Oct 30 01:11:17.281048 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 118/225] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:16 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1724 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:17.286721 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] HTTP exception thrown: Instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf could not be found. Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Request method failure captured: Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf HTTP/1.1 Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc8VHH_0_ledOYr0NcHgNys8zriqMbfKtOYXvwaHFvekYag_nBYlivmIELTh9Qs1rNivHzse5ONrmr6UXG7AO2gF_weAXXi1DVNnDo8TKXHCp6XveLqZy6zScgKuFPtpJ6m2DeQ_O6VFs-_s90fVlei1tSVkW9WpNQEnVJ9o-MBeSAo Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: b3ac92b862ae4d988409b01c3adfef75 Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesActionsTest-1109761261 Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:11:17.289164 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesActionsTest-1109761261 Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: b3ac92b862ae4d988409b01c3adfef75 Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesActionsTest-1109761261 Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesActionsTest-1109761261-project Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 19714f6672d345a38370effe826a3d2a Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesActionsTest-1109761261-project Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf could not be found. Oct 30 01:11:17.290550 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '30298691-7c9f-46a5-bfe7-02e32ff5fbaf'} Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf could not be found. Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:11:17.291367 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf could not be found. Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf could not be found. Oct 30 01:11:17.292530 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:17.294899 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Returning 404 to user: Instance 30298691-7c9f-46a5-bfe7-02e32ff5fbaf could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:11:17.300070 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9b33ee10-fb86-446e-b58c-e68a481b16ed tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf" status: 404 len: 111 microversion: 2.1 time: 0.107901 Oct 30 01:11:17.306684 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 108/226] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:17 2022] GET /compute/v2.1/servers/30298691-7c9f-46a5-bfe7-02e32ff5fbaf => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:11:17.562519 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-569329055", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "networks": [{"uuid": "9dfe5552-55fb-47a8-85eb-9baab719c343"}]}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:17.673003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] validate_networks() for [('9dfe5552-55fb-47a8-85eb-9baab719c343', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:11:17.692031 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:17.693968 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:17.706076 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:17.707438 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:17.708646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:17.712268 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:17.713943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:17.715283 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:17.733630 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:18.190038 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=8 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:18.274995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:18.295970 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fbe858f1-def6-47a7-88ab-eb67f1a8099e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.609533 Oct 30 01:11:18.306355 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 109/227] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:17 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:18.326837 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:18.327900 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:18.336136 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:18.337193 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:18.337624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:18.338658 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:18.339608 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:18.340672 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:18.744259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:18.775856 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b7232ea4-6f9d-411b-be31-05a422f2024b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1701 microversion: 2.1 time: 0.455248 Oct 30 01:11:18.779076 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 110/228] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:18 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1701 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:18.816516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-12506458-a614-41d8-87b4-bf7614d9de32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:18.826863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-12506458-a614-41d8-87b4-bf7614d9de32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:18.827571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-12506458-a614-41d8-87b4-bf7614d9de32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:18.829504 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-12506458-a614-41d8-87b4-bf7614d9de32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:18.837806 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:11:18.838593 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:11:18.842861 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:11:18.855657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:11:18.856785 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:11:18.912125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:18.922724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:18.924319 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:18.926253 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:18.931852 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:18.934156 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:19.000642 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Getting quotas for project b3ac92b862ae4d988409b01c3adfef75. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:11:19.012659 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Getting quotas for user 19714f6672d345a38370effe826a3d2a and project b3ac92b862ae4d988409b01c3adfef75. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:11:19.048460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-12506458-a614-41d8-87b4-bf7614d9de32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Going to try to start instance {{(pid=119524) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 01:11:19.067095 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:11:19.076822 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:11:19.308445 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=6 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:19.438311 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-12506458-a614-41d8-87b4-bf7614d9de32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action" status: 202 len: 0 microversion: 2.1 time: 0.630657 Oct 30 01:11:19.439648 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 111/229] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:11:18 2022] POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:11:19.449165 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-1ffc1623-d082-4f5d-9c5d-8970a13df279 req-119b225e-fe80-498a-994f-feac13b50953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d6250d-ab71-49d8-843e-633f61eb9458", "tag": "a670959f-9524-4528-b199-1b19260d3767"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:19.475718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-1ffc1623-d082-4f5d-9c5d-8970a13df279 req-119b225e-fe80-498a-994f-feac13b50953 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:19.476570 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-1ffc1623-d082-4f5d-9c5d-8970a13df279 req-119b225e-fe80-498a-994f-feac13b50953 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:19.477221 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-1ffc1623-d082-4f5d-9c5d-8970a13df279 req-119b225e-fe80-498a-994f-feac13b50953 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:19.509581 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-1ffc1623-d082-4f5d-9c5d-8970a13df279 req-119b225e-fe80-498a-994f-feac13b50953 service nova] Creating event network-changed:a670959f-9524-4528-b199-1b19260d3767 for instance 56d6250d-ab71-49d8-843e-633f61eb9458 on hv-cinder-maste Oct 30 01:11:19.517113 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-1ffc1623-d082-4f5d-9c5d-8970a13df279 req-119b225e-fe80-498a-994f-feac13b50953 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074813 Oct 30 01:11:19.518032 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 112/230] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:19.524894 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:19.525971 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:19.533970 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:19.534829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:19.535797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:19.537847 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:19.538527 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:19.539134 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:19.557192 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d4a6cf8f-09c2-4486-812f-e9e9dd6a1797 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002753 Oct 30 01:11:19.571512 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 119/231] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:11:19.582219 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:19.584535 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:19.613290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:19.614836 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:19.615962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:19.617545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:19.618527 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:19.621213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:19.990842 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:20.017727 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8c45dec7-03f3-4424-aa71-70d0a74079a7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.498238 Oct 30 01:11:20.031737 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 113/232] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:19 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:20.031737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1187d93b-da47-4bbe-a294-dfc05133c86e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:20.033259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1187d93b-da47-4bbe-a294-dfc05133c86e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:20.217973 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:20.232273 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-082160e3-29a8-4d63-aa14-dd3824c4eef1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1710 microversion: 2.1 time: 0.656945 Oct 30 01:11:20.236018 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 120/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:19 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1710 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:20.275350 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1187d93b-da47-4bbe-a294-dfc05133c86e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:20.302360 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1187d93b-da47-4bbe-a294-dfc05133c86e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1213 microversion: 2.1 time: 0.279182 Oct 30 01:11:20.303266 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 114/234] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:20 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1213 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:21.064196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:21.065040 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:21.073099 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:21.073835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:21.074342 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:21.075183 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:21.075988 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:21.087316 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:21.284201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:21.286403 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:21.305805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:21.305805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:21.305805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:21.305805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:21.308171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:21.308867 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:21.545779 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:21.561695 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:21.564410 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7dd241d1-730a-4813-af59-14ec5e475107 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.504811 Oct 30 01:11:21.565021 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 121/235] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:21 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:21.571534 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:21.572526 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:21.604665 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:21.605267 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:21.605982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:21.608914 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:21.616051 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:21.616740 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:21.776916 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:21.788861 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-21511d38-2355-4d9a-90b4-d108ebff2391 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1217 microversion: 2.1 time: 0.222571 Oct 30 01:11:21.802096 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 122/236] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:21 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:21.802246 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:21.822277 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-29be9004-0770-4a85-a9a5-703cda0d9423 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1710 microversion: 2.1 time: 0.541557 Oct 30 01:11:21.825293 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 115/237] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:21 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1710 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:22.596718 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:22.597810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:22.610485 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:22.611348 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:22.612088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:22.613311 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:22.614747 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:22.615345 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:22.667566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1162953547", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "networks": [{"uuid": "32880eeb-e493-4688-8da8-8b7c1a83fec5"}]}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:22.778467 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] validate_networks() for [('32880eeb-e493-4688-8da8-8b7c1a83fec5', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:11:23.001817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:23.009384 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-63edd842-0a82-47a4-953a-2ea4cfdc8e2e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.419076 Oct 30 01:11:23.009995 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 123/238] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:22 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:23.017660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:23.018558 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:23.047955 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:23.048984 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:23.049785 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:23.050823 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:23.052253 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:23.052890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:23.185178 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:23.202537 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0c438a6e-c3e7-44fb-b7a1-3086b976bb6a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1265 microversion: 2.1 time: 0.188979 Oct 30 01:11:23.205138 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 124/239] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:23 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:23.213627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:23.224497 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:23.239531 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:23.240404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:23.241376 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:23.242289 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:23.255349 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:23.256202 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:23.683778 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:23.709788 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-954c206a-cf5d-4323-840c-eba56558d352 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1710 microversion: 2.1 time: 0.502814 Oct 30 01:11:23.710413 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 125/240] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:23 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1710 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:23.751264 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:11:23.752182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:11:23.752540 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:11:23.753112 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:11:23.753643 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:11:23.777395 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:23.778551 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:23.779967 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:23.783346 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:23.784636 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:23.785736 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:23.827017 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Getting quotas for project ec0e8d209ae34edca0d7dc5dae71129a. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:11:23.834932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Getting quotas for user 9254fc77e32147fdb3a28422b8458039 and project ec0e8d209ae34edca0d7dc5dae71129a. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:11:23.863251 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:11:23.866640 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:11:24.036678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:24.037711 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:24.074904 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b58c68ef-6e8b-41f2-893e-975014d0ca5b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414568 Oct 30 01:11:24.090500 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 116/241] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:11:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:11:24.109364 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:24.112221 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-82744960-1f62-4af3-ba4a-f2c803d060f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:24.113621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-82744960-1f62-4af3-ba4a-f2c803d060f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:24.114674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:24.116949 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:24.142891 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:24.150110 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:24.168915 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:24.168915 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:24.331837 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-82744960-1f62-4af3-ba4a-f2c803d060f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:24.352270 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-82744960-1f62-4af3-ba4a-f2c803d060f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1219 microversion: 2.1 time: 0.259334 Oct 30 01:11:24.354429 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 117/242] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:24 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1219 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:24.384397 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:24.389111 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:24.423409 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:24.424373 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:24.433410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:24.434651 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:24.435549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:24.458977 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:24.686323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:24.709327 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ff730629-493e-4ed0-ad5f-a6c8d3139744 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1283 microversion: 2.1 time: 0.352560 Oct 30 01:11:24.725073 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 118/243] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:24 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1283 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:24.733314 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:24.750997 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fd5f9226-4473-4483-8cbf-e1cdf7a6514c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.721318 Oct 30 01:11:24.755692 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 126/244] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:24 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:24.758345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:24.759453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:24.771402 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:24.772277 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:24.773060 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:24.774620 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:24.776149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:24.776293 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:24.809271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:25.079816 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:25.088977 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f84fd298-008f-4bb6-88e9-a704d00c9424 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1714 microversion: 2.1 time: 0.340872 Oct 30 01:11:25.092374 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 119/245] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:24 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1714 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:25.390844 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7929cd94-4c56-4912-a625-ecc8adbff462 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:25.391453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7929cd94-4c56-4912-a625-ecc8adbff462 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:25.501536 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7929cd94-4c56-4912-a625-ecc8adbff462 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:25.518667 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7929cd94-4c56-4912-a625-ecc8adbff462 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1219 microversion: 2.1 time: 0.131372 Oct 30 01:11:25.520762 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 127/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:25 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:25.764325 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:25.766624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:25.780312 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:25.781854 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:25.782746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:25.784555 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:25.786183 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:25.793037 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:25.794742 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:25.794742 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:25.801895 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:25.802400 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:25.802841 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:25.803889 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:25.805214 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:25.805948 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:26.293835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:26.319282 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:26.334092 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-819b5190-8a6c-4ca7-8952-0440a80a1ea2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.548091 Oct 30 01:11:26.334278 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3dcb2844-8860-45cc-969a-a2f564bf050e tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.571735 Oct 30 01:11:26.335465 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 128/247] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:25 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:26.349933 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 120/248] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:25 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:26.359805 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-6bd1ff5f-9da8-4ffd-a1f9-95c4ac085c21 req-af03ba11-75b7-4b9b-89c3-d1f0f0595df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d6250d-ab71-49d8-843e-633f61eb9458", "name": "network-vif-plugged", "status": "completed", "tag": "a670959f-9524-4528-b199-1b19260d3767"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:26.365727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:26.378851 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-6bd1ff5f-9da8-4ffd-a1f9-95c4ac085c21 req-af03ba11-75b7-4b9b-89c3-d1f0f0595df7 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:26.380210 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-6bd1ff5f-9da8-4ffd-a1f9-95c4ac085c21 req-af03ba11-75b7-4b9b-89c3-d1f0f0595df7 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:26.381047 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-6bd1ff5f-9da8-4ffd-a1f9-95c4ac085c21 req-af03ba11-75b7-4b9b-89c3-d1f0f0595df7 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:26.395414 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-6bd1ff5f-9da8-4ffd-a1f9-95c4ac085c21 req-af03ba11-75b7-4b9b-89c3-d1f0f0595df7 service nova] Creating event network-vif-plugged:a670959f-9524-4528-b199-1b19260d3767 for instance 56d6250d-ab71-49d8-843e-633f61eb9458 on hv-cinder-maste Oct 30 01:11:26.411029 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-6bd1ff5f-9da8-4ffd-a1f9-95c4ac085c21 req-af03ba11-75b7-4b9b-89c3-d1f0f0595df7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071617 Oct 30 01:11:26.412615 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 129/249] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:26.548681 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:26.549771 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:26.567375 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:26.568262 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:26.568924 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:26.569862 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:26.570506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:26.572200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:26.747061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:26.762797 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b28c6804-b632-4371-bc50-e6f190ab0d2b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1215 microversion: 2.1 time: 0.223509 Oct 30 01:11:26.763641 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 121/250] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:26 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:27.363124 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:27.363965 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:27.372497 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:27.380092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:27.380092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:27.380092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:27.380092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:27.380820 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:27.380945 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:27.380945 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:27.396681 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:27.398058 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:27.400115 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:27.401705 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:27.402485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:27.404530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:27.809464 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:27.822193 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-299e205f-7568-4f03-82b9-2827a2ec9d00 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.453930 Oct 30 01:11:27.823911 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 122/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:27 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:27.827250 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:27.842580 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:27.844028 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:27.848855 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a7dcc8b1-8028-41e3-ab8d-d7c3f8eb3ef1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.488837 Oct 30 01:11:27.848855 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 130/252] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:27 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:27.858991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:27.860229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:27.861206 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:27.862689 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:27.866466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:27.868436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:28.235013 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-b30551b7-7552-4b0e-bb7d-58be6e08ff33 req-67972232-bae7-40dc-8048-d7ba8b5af812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f338156-f2f0-449c-b7cb-450c73e2aa65", "tag": "3f3cffc4-e331-4a54-8ed2-c9aa3bd27ab8"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:28.277013 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:28.282035 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-b30551b7-7552-4b0e-bb7d-58be6e08ff33 req-67972232-bae7-40dc-8048-d7ba8b5af812 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:28.286179 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-b30551b7-7552-4b0e-bb7d-58be6e08ff33 req-67972232-bae7-40dc-8048-d7ba8b5af812 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:28.286792 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-b30551b7-7552-4b0e-bb7d-58be6e08ff33 req-67972232-bae7-40dc-8048-d7ba8b5af812 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:28.325732 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-b30551b7-7552-4b0e-bb7d-58be6e08ff33 req-67972232-bae7-40dc-8048-d7ba8b5af812 service nova] Creating event network-changed:3f3cffc4-e331-4a54-8ed2-c9aa3bd27ab8 for instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 on hv-cinder-maste Oct 30 01:11:28.326055 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-743d4dd4-4254-4627-8dd3-a665965cf6ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1271 microversion: 2.1 time: 0.495535 Oct 30 01:11:28.332889 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 123/253] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:27 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1271 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:28.338453 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-b30551b7-7552-4b0e-bb7d-58be6e08ff33 req-67972232-bae7-40dc-8048-d7ba8b5af812 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107344 Oct 30 01:11:28.342611 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 131/254] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:28.848053 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:28.848698 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:28.871729 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:28.874848 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:28.875715 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:28.880522 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:28.881948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:28.883333 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:28.903818 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:28.907882 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:28.927099 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:28.938300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:28.939445 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:28.940693 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:28.941466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:28.942978 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:28.956469 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:29.574021 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:29.599074 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6413c55c-52eb-416c-867c-686f44c0a464 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.750571 Oct 30 01:11:29.599074 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 124/255] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:28 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:29.602430 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:29.603248 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:29.630158 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:29.630654 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:29.631797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:29.635973 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:29.635973 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:29.635973 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:29.636609 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:29.648404 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-38659ed7-fef6-4733-b4b7-3fb2dad58e0e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1368 microversion: 2.1 time: 0.754313 Oct 30 01:11:29.658306 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 132/256] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:28 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1368 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:29.892063 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:29.903826 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b5ec86a3-765b-4d09-9ca6-12ef6b04ea30 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1279 microversion: 2.1 time: 0.307155 Oct 30 01:11:29.904969 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 125/257] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:29 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1279 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:30.632220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:30.633043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:30.668047 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:30.669418 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:30.684265 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:30.686111 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:30.695036 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:30.695036 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:30.696117 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:30.696117 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:30.701487 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:30.702500 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:30.703157 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:30.704142 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:30.704822 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:30.705545 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:31.310228 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:31.322503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:31.352672 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-dbde630e-d4d3-409b-a2ba-d5ea72263126 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.725938 Oct 30 01:11:31.354909 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 133/258] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:30 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:31.367746 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d3bc302f-76c0-446f-a6d9-92ce43ffedd9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1563 microversion: 2.1 time: 0.670843 Oct 30 01:11:31.367979 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:31.367979 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:31.384935 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 126/259] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:30 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1563 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:31.385090 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:31.385090 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:31.385377 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:31.387208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:31.395523 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:31.395523 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:31.401669 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:31.404771 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:31.438428 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:31.439415 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:31.440352 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:31.441646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:31.442504 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:31.443264 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:31.725544 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-bbb0fc3d-52bb-42e5-8414-2dfb48a23ec9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.328852 Oct 30 01:11:31.727128 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 127/260] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:11:31 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-interface => generated 285 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:31.840744 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:31.858313 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0764eb7f-bbcd-4bbd-ba85-d6f5466d67c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.503061 Oct 30 01:11:31.860952 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 134/261] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:31 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:32.416290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:32.420114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:32.448044 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:32.449406 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:32.450787 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:32.452404 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:32.453653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:32.455054 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:32.831337 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:32.846266 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6250575a-b74a-4ed9-a672-209c83d70c18 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.445603 Oct 30 01:11:32.851715 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 128/262] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:32 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:32.903488 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:32.904978 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:32.913588 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:32.914408 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:32.915429 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:32.916605 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:32.917752 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:32.918594 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:33.287006 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:33.314431 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c242b82e-5c14-4505-b899-722577c57010 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.418315 Oct 30 01:11:33.332149 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 135/263] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:32 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:33.530491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-3cf805c9-ded3-4341-b1f7-d4bd02c26efc req-e6bfebf4-2877-40ee-ade5-9bcb10ab2b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0060d3a-0447-440d-9a30-3d194419de58", "tag": "703d5b5a-5333-40f3-b279-7fd21ceb03d3"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:33.553512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3cf805c9-ded3-4341-b1f7-d4bd02c26efc req-e6bfebf4-2877-40ee-ade5-9bcb10ab2b1b service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:33.554153 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3cf805c9-ded3-4341-b1f7-d4bd02c26efc req-e6bfebf4-2877-40ee-ade5-9bcb10ab2b1b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:33.554912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3cf805c9-ded3-4341-b1f7-d4bd02c26efc req-e6bfebf4-2877-40ee-ade5-9bcb10ab2b1b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:33.570845 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-3cf805c9-ded3-4341-b1f7-d4bd02c26efc req-e6bfebf4-2877-40ee-ade5-9bcb10ab2b1b service nova] Creating event network-changed:703d5b5a-5333-40f3-b279-7fd21ceb03d3 for instance d0060d3a-0447-440d-9a30-3d194419de58 on hv-cinder-maste Oct 30 01:11:33.577598 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-3cf805c9-ded3-4341-b1f7-d4bd02c26efc req-e6bfebf4-2877-40ee-ade5-9bcb10ab2b1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053849 Oct 30 01:11:33.578480 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 129/264] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:33.767761 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1931219551", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "networks": [{"uuid": "74c0ddcd-2fba-475e-937a-89a878861611"}]}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:33.782894 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-395a6937-e659-424b-9549-8e84f385df03 req-6f93501a-5bb4-444b-8869-d98b01305361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d6250d-ab71-49d8-843e-633f61eb9458", "tag": "a670959f-9524-4528-b199-1b19260d3767"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:33.816928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:33.834594 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-395a6937-e659-424b-9549-8e84f385df03 req-6f93501a-5bb4-444b-8869-d98b01305361 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:33.835392 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-395a6937-e659-424b-9549-8e84f385df03 req-6f93501a-5bb4-444b-8869-d98b01305361 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:33.836056 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-395a6937-e659-424b-9549-8e84f385df03 req-6f93501a-5bb4-444b-8869-d98b01305361 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:33.856233 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-395a6937-e659-424b-9549-8e84f385df03 req-6f93501a-5bb4-444b-8869-d98b01305361 service nova] Creating event network-changed:a670959f-9524-4528-b199-1b19260d3767 for instance 56d6250d-ab71-49d8-843e-633f61eb9458 on hv-cinder-maste Oct 30 01:11:33.864847 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-395a6937-e659-424b-9549-8e84f385df03 req-6f93501a-5bb4-444b-8869-d98b01305361 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085821 Oct 30 01:11:33.868387 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 130/265] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:33.881820 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:33.885410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:33.885982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] validate_networks() for [('74c0ddcd-2fba-475e-937a-89a878861611', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:11:33.892177 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:33.892751 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:33.893182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:33.893896 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:33.895068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:33.895502 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:34.340489 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=10 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:34.773604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:34.796266 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7e97f76f-0233-40c6-a6d4-8fd7ac45ad2f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.919342 Oct 30 01:11:34.818050 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 131/266] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:33 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:34.820454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:34.822513 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:34.832982 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:34.834217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:34.834884 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:34.848512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:34.849492 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:34.850348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:35.240429 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:35.247103 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c60eab41-d9bc-45f4-8525-9d68c9d47e66 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.434729 Oct 30 01:11:35.247903 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 132/267] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:34 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:35.322476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:11:35.323050 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:11:35.323740 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:11:35.324705 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:11:35.334073 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:11:35.350351 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:35.350803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:35.356426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:35.356426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:35.356426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:35.356426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:35.379198 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Getting quotas for project a0dd3a3ba566479d94d5438d890da279. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:11:35.384717 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Getting quotas for user 7773de8f0ee743c9881d441e8e9d8fc2 and project a0dd3a3ba566479d94d5438d890da279. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:11:35.407477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:11:35.407477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:11:35.600491 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ecd05dc3-bd1f-4e6e-8c6a-e9df28c00067 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002576 Oct 30 01:11:35.614087 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 136/268] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:11:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:11:35.620146 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ffc884bf-0d2c-41f7-bef2-2e24037cac57 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:35.621069 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ffc884bf-0d2c-41f7-bef2-2e24037cac57 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:35.748236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ffc884bf-0d2c-41f7-bef2-2e24037cac57 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:35.757014 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ffc884bf-0d2c-41f7-bef2-2e24037cac57 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1214 microversion: 2.1 time: 0.140443 Oct 30 01:11:35.757931 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 133/269] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:35 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:35.840335 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:35.840595 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:35.847402 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:35.848040 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:35.848583 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:35.849384 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:35.850296 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:35.850472 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:36.010800 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:36.028044 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ae7048ae-b3df-439c-887f-c1005bfe5ea8 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.191322 Oct 30 01:11:36.029248 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 137/270] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:35 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:36.277901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:36.279444 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:36.289737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:36.290364 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:36.291889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:36.292422 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:36.293191 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:36.293944 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:36.570056 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:36.589490 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fb0c280a-a371-4583-96e8-d45b7b3a9782 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.317368 Oct 30 01:11:36.590277 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 134/271] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:36 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:36.802502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d3e2699c-4418-4bd2-a726-6a7ceb31af88 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:36.803326 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d3e2699c-4418-4bd2-a726-6a7ceb31af88 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:36.868852 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d3e2699c-4418-4bd2-a726-6a7ceb31af88 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:36.883631 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d3e2699c-4418-4bd2-a726-6a7ceb31af88 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1214 microversion: 2.1 time: 0.089254 Oct 30 01:11:36.885053 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 138/272] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:36 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:37.057374 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:37.058504 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:37.069291 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:37.070149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:37.070867 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:37.072153 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:37.072928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:37.073663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:37.270314 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:37.281524 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f655e9b0-12cd-40c2-8ec0-cd0a3531bfcf tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.232240 Oct 30 01:11:37.282233 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 135/273] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:37 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:37.620100 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:37.621617 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:37.633482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:37.634373 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:37.635627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:37.636889 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:37.637841 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:37.638642 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:37.863937 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:37.880517 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-91ec6243-a48a-41b3-8150-c2035a51a6b3 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.269269 Oct 30 01:11:37.896004 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 139/274] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:37 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:37.914915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:37.916322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:37.930192 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:37.931168 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:37.934891 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:37.938608 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:37.939751 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:37.940286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:38.043324 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:38.055273 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-334f5059-38b6-483c-b19e-1a1d1c968d4a tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1266 microversion: 2.1 time: 0.147110 Oct 30 01:11:38.056174 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 136/275] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:37 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:38.302138 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-f9ae4c25-7ec7-4e8a-914f-5e77c808af3f req-e271f312-f588-4e39-8438-02d64863c569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f338156-f2f0-449c-b7cb-450c73e2aa65", "name": "network-vif-plugged", "status": "completed", "tag": "3f3cffc4-e331-4a54-8ed2-c9aa3bd27ab8"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:38.337319 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-f9ae4c25-7ec7-4e8a-914f-5e77c808af3f req-e271f312-f588-4e39-8438-02d64863c569 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:38.338380 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:38.339075 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-f9ae4c25-7ec7-4e8a-914f-5e77c808af3f req-e271f312-f588-4e39-8438-02d64863c569 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:38.339457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-f9ae4c25-7ec7-4e8a-914f-5e77c808af3f req-e271f312-f588-4e39-8438-02d64863c569 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:38.341876 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:38.354189 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:38.355120 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:38.355827 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:38.356706 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:38.357547 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:38.358410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:38.362119 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-f9ae4c25-7ec7-4e8a-914f-5e77c808af3f req-e271f312-f588-4e39-8438-02d64863c569 service nova] Creating event network-vif-plugged:3f3cffc4-e331-4a54-8ed2-c9aa3bd27ab8 for instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 on hv-cinder-maste Oct 30 01:11:38.372744 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-f9ae4c25-7ec7-4e8a-914f-5e77c808af3f req-e271f312-f588-4e39-8438-02d64863c569 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078562 Oct 30 01:11:38.374433 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 140/276] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:11:38.593453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:38.602500 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e165c465-8ff4-44f2-8b6b-a5d8d0d2e4fd tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.282218 Oct 30 01:11:38.609902 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 137/277] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:38 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:38.919355 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:38.921998 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:38.928714 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:38.929473 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:38.929909 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:38.930645 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:38.931097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:38.931968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:39.079775 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:39.080625 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:39.088214 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:39.088835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:39.089383 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:39.090325 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:39.090897 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:39.091430 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:39.251616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:39.255784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=100 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:39.264708 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fbfbf52c-c10d-4241-8239-a97eab6aa8f7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1274 microversion: 2.1 time: 0.189362 Oct 30 01:11:39.265401 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 138/278] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:39 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:39.333066 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:39.344832 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7e82c929-5fed-4014-8b04-9d40fc00617c tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.430146 Oct 30 01:11:39.345523 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 141/279] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:38 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:39.633336 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:39.633946 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:39.640929 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:39.641428 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:39.641864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:39.642582 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:39.643040 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:39.643464 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:39.897837 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:39.916083 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-efda9d30-ad56-4c19-80fa-a1a9544b8f01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.285634 Oct 30 01:11:39.916083 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 139/280] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:39 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:40.289389 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:40.289998 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:40.296510 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:40.297006 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:40.297438 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:40.298196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:40.298704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:40.299071 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:40.389398 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:40.390425 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:40.403424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:40.404646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:40.405653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:40.407210 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:40.408663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:40.409768 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:40.602154 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:40.622988 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f0ac87c9-00e6-4e70-a524-60d711e73225 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.337721 Oct 30 01:11:40.623741 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 142/281] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:40 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:40.629526 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-df951bb4-50fb-4d15-93e7-b511153deb52 req-ac7ac831-4fc3-4268-ae7e-b26ab8e21ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0060d3a-0447-440d-9a30-3d194419de58", "name": "network-vif-plugged", "status": "completed", "tag": "703d5b5a-5333-40f3-b279-7fd21ceb03d3"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:40.641340 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-df951bb4-50fb-4d15-93e7-b511153deb52 req-ac7ac831-4fc3-4268-ae7e-b26ab8e21ea3 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:40.642087 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-df951bb4-50fb-4d15-93e7-b511153deb52 req-ac7ac831-4fc3-4268-ae7e-b26ab8e21ea3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:40.642677 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-df951bb4-50fb-4d15-93e7-b511153deb52 req-ac7ac831-4fc3-4268-ae7e-b26ab8e21ea3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:40.652706 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:40.670108 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:40.670710 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-df951bb4-50fb-4d15-93e7-b511153deb52 req-ac7ac831-4fc3-4268-ae7e-b26ab8e21ea3 service nova] Creating event network-vif-plugged:703d5b5a-5333-40f3-b279-7fd21ceb03d3 for instance d0060d3a-0447-440d-9a30-3d194419de58 on hv-cinder-maste Oct 30 01:11:40.681237 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-63ffb4ec-1dbc-4105-a096-6c9b1912c829 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.300866 Oct 30 01:11:40.682172 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 140/282] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:40 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:40.683362 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-df951bb4-50fb-4d15-93e7-b511153deb52 req-ac7ac831-4fc3-4268-ae7e-b26ab8e21ea3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057988 Oct 30 01:11:40.684899 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 143/283] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:40.943503 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:40.944686 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:40.955977 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:40.956859 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:40.957705 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:40.960519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:40.960519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:40.960845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:41.145006 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:41.153248 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-40b983e6-cb82-4958-8259-6a38c1819ecb tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1313 microversion: 2.1 time: 0.217430 Oct 30 01:11:41.153916 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 141/284] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:40 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:41.661937 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:41.663329 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:41.670956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:41.671801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:41.672244 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:41.672974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:41.673598 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:41.674178 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:41.713890 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:41.714925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:41.723511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:41.724038 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:41.724665 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:41.728085 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:41.728085 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:41.728085 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:41.999125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:42.016794 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-206976fd-cc97-4052-8447-5fe310650f35 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.359678 Oct 30 01:11:42.032051 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 144/285] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:41 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:42.035898 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:42.059202 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f02f779e-c1b0-4532-9ad8-82693207c5c7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.348651 Oct 30 01:11:42.061786 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 142/286] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:41 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:42.177377 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:42.178026 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:42.184301 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:42.185032 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:42.185466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:42.186171 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:42.186625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:42.187038 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:42.339343 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:42.349142 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-cdbb3edc-3c61-4daa-833e-11a893b7af8a tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1498 microversion: 2.1 time: 0.175723 Oct 30 01:11:42.350082 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 145/287] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:42 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:42.413781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-1a8573d2-7f0d-442c-9478-23a38b32e0be req-fc9e4a08-d743-4734-8ba6-4f282168eaea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d154707-ac3e-4bcb-9f3e-284e2c170554", "tag": "03eb0a97-946a-4626-b96b-c6fe5ef42b76"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:42.430390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-1a8573d2-7f0d-442c-9478-23a38b32e0be req-fc9e4a08-d743-4734-8ba6-4f282168eaea service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:42.431260 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-1a8573d2-7f0d-442c-9478-23a38b32e0be req-fc9e4a08-d743-4734-8ba6-4f282168eaea service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:42.431828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-1a8573d2-7f0d-442c-9478-23a38b32e0be req-fc9e4a08-d743-4734-8ba6-4f282168eaea service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:42.452240 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-1a8573d2-7f0d-442c-9478-23a38b32e0be req-fc9e4a08-d743-4734-8ba6-4f282168eaea service nova] Creating event network-changed:03eb0a97-946a-4626-b96b-c6fe5ef42b76 for instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 on hv-cinder-maste Oct 30 01:11:42.461013 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-1a8573d2-7f0d-442c-9478-23a38b32e0be req-fc9e4a08-d743-4734-8ba6-4f282168eaea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052123 Oct 30 01:11:42.462502 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 143/288] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:11:43.049943 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:43.051148 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:43.062213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:43.063086 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:43.063877 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:43.065025 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:43.065729 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:43.066951 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:43.109981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:43.109981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:43.136258 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:43.141739 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:43.144893 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:43.145884 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:43.147949 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:43.148798 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:43.392462 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:43.404700 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a3914452-4682-4ba0-bb67-a7e532544381 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.362067 Oct 30 01:11:43.406003 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 146/289] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:43 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:43.432758 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:43.441079 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a21c63d6-e781-4454-94cb-a316a7648dd7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1319 microversion: 2.1 time: 0.344094 Oct 30 01:11:43.442674 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 144/290] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:43 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:43.944843 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:43.945991 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:43.954523 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:43.955011 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:43.955822 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:43.957423 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:43.957885 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:43.958303 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:43.994272 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:11:44.429968 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:44.429968 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:44.442379 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:44.443155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:44.443696 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:44.444480 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:44.445118 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:44.445802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:44.465796 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7a47e432-298b-4dc8-ba3b-28599365d8ab tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 204 len: 0 microversion: 2.1 time: 0.527231 Oct 30 01:11:44.473746 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 147/291] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:11:43 2022] DELETE /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:11:44.473746 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:44.474432 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:44.481470 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:44.481977 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:44.482411 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:44.483129 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:44.483751 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:44.484392 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:44.725280 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:44.735048 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-bec1e9fe-120e-4f59-b4c4-47bbae3ef44d tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.310162 Oct 30 01:11:44.735912 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 145/292] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:44 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:44.742872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:44.743884 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:44.745028 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:44.752005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:44.752995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:44.754945 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:44.756777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:44.758072 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:44.759561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:44.765696 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9cac6e43-27cf-465e-a456-b0a3aa5449f4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1508 microversion: 2.1 time: 0.296670 Oct 30 01:11:44.766958 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 148/293] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:44 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:44.941681 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:44.950879 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-434643dd-8883-4df1-8e81-56d07e5092e7 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1504 microversion: 2.1 time: 0.213706 Oct 30 01:11:44.951568 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 146/294] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:44 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:45.778690 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:45.779394 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:45.781502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:45.787388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:45.787887 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:45.788331 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:45.789040 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:45.789640 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:45.790151 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:45.966332 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:45.974524 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6b1d7aad-cc1f-486a-93d9-e34c7ce18677 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.201366 Oct 30 01:11:45.975110 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 149/295] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:45 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:45.994672 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:45.996421 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:46.006671 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:46.009198 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:46.009990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:46.010831 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:46.012116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:46.012979 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:46.013720 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:46.192560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:46.203427 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d79dbaee-755b-4fab-b560-937554e1096f tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1504 microversion: 2.1 time: 0.215566 Oct 30 01:11:46.204354 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 147/296] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:45 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:47.000861 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:47.001466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:47.004643 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=16 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:47.010877 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:47.015193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:47.015193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:47.015193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:47.015193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:47.015931 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:47.193122 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:47.208115 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4655bf09-089c-46cf-8907-3493e2fbec91 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.212563 Oct 30 01:11:47.208992 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 150/297] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:46 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:47.229084 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:47.230282 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:47.241543 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:47.242353 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:47.242857 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:47.244049 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:47.244741 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:47.245386 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:47.419812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:47.434983 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9c1e75ec-4273-4f9e-a053-ea21b4dd7665 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1504 microversion: 2.1 time: 0.205375 Oct 30 01:11:47.434983 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 148/298] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:47 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:48.247105 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:48.247686 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:48.254346 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:48.254962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:48.255440 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:48.256232 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:48.256720 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:48.257225 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:48.383203 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-651bfbd3-6770-44f0-8474-fe3c65d61a18 req-3313cf24-7d6b-4f47-a2c2-a0a3bea39532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f338156-f2f0-449c-b7cb-450c73e2aa65", "name": "network-vif-deleted", "tag": "3f3cffc4-e331-4a54-8ed2-c9aa3bd27ab8"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:48.398834 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-651bfbd3-6770-44f0-8474-fe3c65d61a18 req-3313cf24-7d6b-4f47-a2c2-a0a3bea39532 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:48.399842 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-651bfbd3-6770-44f0-8474-fe3c65d61a18 req-3313cf24-7d6b-4f47-a2c2-a0a3bea39532 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:48.400763 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-651bfbd3-6770-44f0-8474-fe3c65d61a18 req-3313cf24-7d6b-4f47-a2c2-a0a3bea39532 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:48.422669 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-651bfbd3-6770-44f0-8474-fe3c65d61a18 req-3313cf24-7d6b-4f47-a2c2-a0a3bea39532 service nova] Creating event network-vif-deleted:3f3cffc4-e331-4a54-8ed2-c9aa3bd27ab8 for instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 on hv-cinder-maste Oct 30 01:11:48.432074 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-651bfbd3-6770-44f0-8474-fe3c65d61a18 req-3313cf24-7d6b-4f47-a2c2-a0a3bea39532 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054255 Oct 30 01:11:48.433187 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 149/299] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:48.434251 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:48.449357 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4e64c478-510d-45e9-a895-efc2b4775f71 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.206147 Oct 30 01:11:48.450435 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 151/300] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:48 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:48.455287 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:48.456165 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:48.466938 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:48.467726 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:48.468322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:48.469310 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:48.469904 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:48.470416 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:48.545326 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:48.556529 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a2ec4c35-94d8-4d31-ab2a-d2bed88e051b tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1462 microversion: 2.1 time: 0.105875 Oct 30 01:11:48.557361 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 150/301] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:48 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:49.475747 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:49.476365 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:49.482768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:49.483246 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:49.483700 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:49.484396 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:49.484874 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:49.485285 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:49.584044 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:49.584880 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:49.594472 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:49.595218 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:49.595921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:49.596786 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:49.597355 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:49.597852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:49.659529 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:49.660452 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:49.661598 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:49.663135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lazy-loading 'fault' on Instance uuid 3f338156-f2f0-449c-b7cb-450c73e2aa65 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:11:49.738868 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19714f6672d345a38370effe826a3d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ac92b862ae4d988409b01c3adfef75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:49.747651 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-57908fd5-53bd-475e-92ca-eabbb69acdcc tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 200 len: 1303 microversion: 2.1 time: 0.167588 Oct 30 01:11:49.748245 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 151/302] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:49 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:49.772894 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:49.782832 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-61b8704a-828e-4e73-bbca-2d628b404085 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.311487 Oct 30 01:11:49.783423 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 152/303] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:49 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:50.785897 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:50.786806 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] [instance: 3f338156-f2f0-449c-b7cb-450c73e2aa65] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:50.797141 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:50.800826 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:50.800826 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:50.800826 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:50.800826 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:50.801454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:50.811700 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:50.813037 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:50.819043 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] HTTP exception thrown: Instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 could not be found. Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Request method failure captured: Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 HTTP/1.1 Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc8VHH_0_ledOYr0NcHgNys8zriqMbfKtOYXvwaHFvekYag_nBYlivmIELTh9Qs1rNivHzse5ONrmr6UXG7AO2gF_weAXXi1DVNnDo8TKXHCp6XveLqZy6zScgKuFPtpJ6m2DeQ_O6VFs-_s90fVlei1tSVkW9WpNQEnVJ9o-MBeSAo Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: b3ac92b862ae4d988409b01c3adfef75 Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesActionsTest-1109761261 Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:11:50.822633 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3ac92b862ae4d988409b01c3adfef75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesActionsTest-1109761261 Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: b3ac92b862ae4d988409b01c3adfef75 Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesActionsTest-1109761261 Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesActionsTest-1109761261-project Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 19714f6672d345a38370effe826a3d2a Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesActionsTest-1109761261-project Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 could not be found. Oct 30 01:11:50.825410 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '3f338156-f2f0-449c-b7cb-450c73e2aa65'} Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 could not be found. Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:11:50.828624 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 could not be found. Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 could not be found. Oct 30 01:11:50.830669 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:11:50.832932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] Returning 404 to user: Instance 3f338156-f2f0-449c-b7cb-450c73e2aa65 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:11:50.832932 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-bac048d6-530a-47db-a965-474019c00e01 tempest-VolumesActionsTest-1109761261 tempest-VolumesActionsTest-1109761261-project] 10.222.0.26 "GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65" status: 404 len: 111 microversion: 2.1 time: 0.047300 Oct 30 01:11:50.833215 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:50.833370 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 152/304] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:50 2022] GET /compute/v2.1/servers/3f338156-f2f0-449c-b7cb-450c73e2aa65 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:11:50.833521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:50.833521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:50.833521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:50.833521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:50.835154 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:51.054355 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:51.069250 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6aaef8df-1e1d-4f4d-bdd0-9f4c438302b0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.265949 Oct 30 01:11:51.070133 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 153/305] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:50 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:52.110214 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:52.111826 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:52.122952 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:52.123629 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:52.124127 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:52.124937 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:52.125453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:52.126015 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:52.243830 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-de26b9f3-3030-4344-97e4-747d1444ecdb req-7340c890-deed-403b-887f-c11570c6f285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d154707-ac3e-4bcb-9f3e-284e2c170554", "name": "network-vif-plugged", "status": "completed", "tag": "03eb0a97-946a-4626-b96b-c6fe5ef42b76"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:52.263363 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-de26b9f3-3030-4344-97e4-747d1444ecdb req-7340c890-deed-403b-887f-c11570c6f285 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:52.263871 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-de26b9f3-3030-4344-97e4-747d1444ecdb req-7340c890-deed-403b-887f-c11570c6f285 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:52.264299 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-de26b9f3-3030-4344-97e4-747d1444ecdb req-7340c890-deed-403b-887f-c11570c6f285 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:52.279048 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-de26b9f3-3030-4344-97e4-747d1444ecdb req-7340c890-deed-403b-887f-c11570c6f285 service nova] Creating event network-vif-plugged:03eb0a97-946a-4626-b96b-c6fe5ef42b76 for instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 on hv-cinder-maste Oct 30 01:11:52.286749 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-de26b9f3-3030-4344-97e4-747d1444ecdb req-7340c890-deed-403b-887f-c11570c6f285 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055146 Oct 30 01:11:52.289124 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 154/306] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:52.350444 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:52.382696 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-633c3323-3f53-47fa-9956-021411bee9a0 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.279135 Oct 30 01:11:52.387647 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 153/307] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:52 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:53.431608 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:53.436014 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:53.459479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:53.459479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:53.459479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:53.459479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:53.460190 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:53.460190 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:53.657902 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:53.668033 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2837edb9-82ee-49b1-a4ac-85463384a033 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.249101 Oct 30 01:11:53.669311 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 155/308] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:53 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:54.692427 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:54.693257 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:54.700727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:54.701251 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:54.701670 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:54.702399 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:54.702909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:54.703829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:54.915440 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:54.927866 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a0661a46-9f3a-4fed-b3fa-7f14dd1c48e7 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1314 microversion: 2.1 time: 0.239106 Oct 30 01:11:54.928771 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 154/309] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:54 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:55.952066 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:55.953868 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:55.962062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:55.962718 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:55.963707 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:55.964935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:55.965667 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:55.966275 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:56.202726 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:56.214125 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-567c3a12-7344-4834-9421-2715fbe84e38 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1499 microversion: 2.1 time: 0.266672 Oct 30 01:11:56.214741 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 156/310] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:55 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:01.171621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:01.172540 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:01.185913 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=82 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:01.199381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:01.201666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:01.201666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:01.201666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:01.203107 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:01.203107 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:01.243017 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:12:01.373630 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:01.615249 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-724a70ea-80c2-46b7-b87f-86e95732231c tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 204 len: 0 microversion: 2.1 time: 0.452278 Oct 30 01:12:01.617282 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 155/311] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:12:01 2022] DELETE /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:12:01.626785 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:01.628896 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:01.631746 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:01.638679 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:01.639544 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:01.640476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:01.641867 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:01.642727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:01.643408 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:01.964638 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:01.978691 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-61a9a80c-1c69-4cbb-a7a2-84d0c149cfaa tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1505 microversion: 2.1 time: 0.356510 Oct 30 01:12:01.980570 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 157/312] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:01 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:03.014004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:03.016492 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:03.035778 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:03.038096 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:03.039797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:03.041415 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:03.042628 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:03.043781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:03.279442 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:03.290849 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-94bb5ac5-e069-4d6f-973f-a6ebf1b99afd tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1505 microversion: 2.1 time: 0.286136 Oct 30 01:12:03.292133 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 156/313] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:03 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:04.300208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-a5790597-5ac3-4dae-b40a-7066e4ca5468 req-dc312153-bf6b-423d-a99d-43d09b7a468f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d154707-ac3e-4bcb-9f3e-284e2c170554", "name": "network-vif-deleted", "tag": "03eb0a97-946a-4626-b96b-c6fe5ef42b76"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:04.311807 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a5790597-5ac3-4dae-b40a-7066e4ca5468 req-dc312153-bf6b-423d-a99d-43d09b7a468f service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:04.312298 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a5790597-5ac3-4dae-b40a-7066e4ca5468 req-dc312153-bf6b-423d-a99d-43d09b7a468f service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:04.312725 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a5790597-5ac3-4dae-b40a-7066e4ca5468 req-dc312153-bf6b-423d-a99d-43d09b7a468f service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:04.325712 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-a5790597-5ac3-4dae-b40a-7066e4ca5468 req-dc312153-bf6b-423d-a99d-43d09b7a468f service nova] Creating event network-vif-deleted:03eb0a97-946a-4626-b96b-c6fe5ef42b76 for instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 on hv-cinder-maste Oct 30 01:12:04.331297 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-a5790597-5ac3-4dae-b40a-7066e4ca5468 req-dc312153-bf6b-423d-a99d-43d09b7a468f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Oct 30 01:12:04.331569 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:04.332275 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 158/314] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:12:04.335173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:04.341485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:04.342040 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:04.342631 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:04.343771 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:04.344505 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:04.344992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:04.420696 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:04.429651 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-533f8cde-3241-43a6-a933-2e93532a13eb tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1463 microversion: 2.1 time: 0.103744 Oct 30 01:12:04.430249 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 157/315] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:04 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1463 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:05.459005 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:05.461271 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:05.471854 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:05.472558 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:05.477545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:05.477545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:05.477545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:05.477545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:05.530914 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:05.532053 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:05.532715 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:05.533564 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lazy-loading 'fault' on Instance uuid 8d154707-ac3e-4bcb-9f3e-284e2c170554 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:12:05.621521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7773de8f0ee743c9881d441e8e9d8fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0dd3a3ba566479d94d5438d890da279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:05.625928 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:05.631355 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-57fcdf7f-a99b-4e45-8cc0-6e3794436735 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 200 len: 1304 microversion: 2.1 time: 0.180674 Oct 30 01:12:05.643772 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 159/316] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:05 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:06.657810 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:06.658944 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] [instance: 8d154707-ac3e-4bcb-9f3e-284e2c170554] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:06.668686 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:06.669648 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:06.670316 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:06.671735 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:06.672755 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:06.673785 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:06.703354 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] HTTP exception thrown: Instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 could not be found. Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Request method failure captured: Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 HTTP/1.1 Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc9AkpkmZSqWV9j939LZBCVgKiwmSAx894bvQVjvATMnvTg4IzqfFvk0xloYyVxwUgYqPuEE_YtX05T0zANt-qwVYT8lbyOnWJ1gKTZFwjWEsD0Q-HT8uIZCGnEPo93m_EbLg0nH3xTeBE0PHT9vooDLDyMTklFo0v-wyO7jAlj4MIY Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: a0dd3a3ba566479d94d5438d890da279 Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesActionsTest-857056305 Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:12:06.707286 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0dd3a3ba566479d94d5438d890da279"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0dd3a3ba566479d94d5438d890da279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0dd3a3ba566479d94d5438d890da279"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0dd3a3ba566479d94d5438d890da279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesActionsTest-857056305 Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: a0dd3a3ba566479d94d5438d890da279 Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesActionsTest-857056305 Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesActionsTest-857056305-project Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 7773de8f0ee743c9881d441e8e9d8fc2 Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesActionsTest-857056305-project Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 could not be found. Oct 30 01:12:06.710367 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '8d154707-ac3e-4bcb-9f3e-284e2c170554'} Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 could not be found. Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:12:06.711778 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 could not be found. Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 could not be found. Oct 30 01:12:06.714259 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:12:06.718326 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] Returning 404 to user: Instance 8d154707-ac3e-4bcb-9f3e-284e2c170554 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:12:06.719760 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2c711de8-394a-4679-be7f-494f90b6c697 tempest-VolumesActionsTest-857056305 tempest-VolumesActionsTest-857056305-project] 10.222.0.26 "GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554" status: 404 len: 111 microversion: 2.1 time: 0.066654 Oct 30 01:12:06.720764 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 158/317] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:06 2022] GET /compute/v2.1/servers/8d154707-ac3e-4bcb-9f3e-284e2c170554 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:12:13.245966 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:13.248058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:13.264587 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:13.265999 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:13.267164 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:13.269394 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:13.270404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:13.271337 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:13.557809 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84045b53-c3f3-4e09-83ce-c3ad8761f5c0", "device": "/dev/sdb"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:13.569949 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:13.585632 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:13.587122 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:13.588857 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:13.590596 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:13.591759 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:13.593138 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:13.614431 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lazy-loading 'services' on Instance uuid 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:12:14.380074 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c73da36e-fa5b-484c-82fc-b0c82c6586eb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-volume_attachments/fb9ad45f-a2e1-4364-9dad-2f3275858bc2" status: 202 len: 0 microversion: 2.1 time: 1.142207 Oct 30 01:12:14.380074 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 160/318] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:12:13 2022] DELETE /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-volume_attachments/fb9ad45f-a2e1-4364-9dad-2f3275858bc2 => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:12:15.380868 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a59c23e5-fb00-4f00-bcc0-4d4bf50b92e1 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "POST /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.841438 Oct 30 01:12:15.381965 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 159/319] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:12:13 2022] POST /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58/os-volume_attachments => generated 194 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:12:16.900149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e05041af-48ef-4244-bfb0-0f7d80ae60bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:16.909309 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e05041af-48ef-4244-bfb0-0f7d80ae60bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:16.910062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e05041af-48ef-4244-bfb0-0f7d80ae60bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:16.910744 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e05041af-48ef-4244-bfb0-0f7d80ae60bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:16.940934 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e05041af-48ef-4244-bfb0-0f7d80ae60bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Going to try to stop instance {{(pid=119523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:12:17.198706 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e05041af-48ef-4244-bfb0-0f7d80ae60bb tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action" status: 202 len: 0 microversion: 2.1 time: 0.295985 Oct 30 01:12:17.206911 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 161/320] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:12:16 2022] POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:12:17.240455 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:17.249912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:17.273077 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:17.273569 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:17.274453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:17.275642 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:17.276324 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:17.277145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:17.533232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:17.552962 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-30b162ef-0a6f-4d7a-9527-f43e4da9db43 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.337867 Oct 30 01:12:17.556129 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 160/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:17 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:18.604925 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:18.611160 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:18.615430 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:18.616056 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:18.616684 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:18.618298 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:18.619023 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:18.619950 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:18.852477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:18.869279 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-184b5561-bd3d-4716-b9cd-aca668343447 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.271385 Oct 30 01:12:18.870879 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 162/322] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:18 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:19.917738 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:19.924837 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:19.960823 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:19.961654 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:19.968275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:19.968275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:19.968275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:19.968275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:20.146491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:20.155089 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6e9d14aa-9765-4a1b-a4ab-946c51e25137 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.256900 Oct 30 01:12:20.169701 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 161/323] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:19 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:21.086980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "84045b53-c3f3-4e09-83ce-c3ad8761f5c0", "create_info": {"type": "qcow2", "new_file": "volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.b7d2d715-599c-4b3b-a007-6c46c449096b.vhdx", "snapshot_id": "b7d2d715-599c-4b3b-a007-6c46c449096b"}}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:21.109169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),981e4b1c-a815-41e8-a403-49a91c7c17f9(cell1) {{(pid=119523) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 30 01:12:21.109625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:21.110100 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:21.110522 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:21.176569 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:21.177347 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:21.178059 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:21.193963 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:21.195302 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:21.209745 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:21.211834 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:21.213340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:21.217115 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:21.218115 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:21.218845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:21.225108 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-def0be6f-5a18-4db5-a588-63e6fd3becdb req-c25cf041-3604-43fb-8fd3-ce88c5ee6a35 admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.399008 Oct 30 01:12:21.226855 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 163/324] 10.222.0.61 () {64 vars in 1326 bytes} [Sun Oct 30 01:12:20 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:12:21.282090 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a26b00bf-a8dc-405e-a808-5384c38ac82d"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:21.289941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:21.344831 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:21.346886 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:21.348200 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:21.349568 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:21.352011 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:21.352498 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:21.826302 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:21.841146 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b922bf5a-0c0d-4434-9f07-f4926a0a5d01 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.653374 Oct 30 01:12:21.842243 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 162/325] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:21 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:22.874466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:22.875623 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:22.883504 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:22.884513 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:22.885010 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:22.886121 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:22.887538 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:22.890797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:23.200530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:23.222461 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f2aab0e0-ee55-41e1-bde4-541fcb0fa241 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.351565 Oct 30 01:12:23.229500 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 163/326] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:22 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:24.002776 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c3591798-decc-46ad-8ef2-ecdb8e798ea6 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.728971 Oct 30 01:12:24.010745 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 164/327] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:12:21 2022] POST /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments => generated 194 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:12:24.255683 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:24.268026 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:24.274454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:24.274454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:24.274454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:24.274812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:24.275151 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:24.275608 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:24.470229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:24.487003 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f178cab2-0c7c-4438-b5ac-9f2795990bb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.238156 Oct 30 01:12:24.488579 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 164/328] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:24 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:25.536112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:25.546501 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:25.603553 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:25.617309 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:25.626730 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:25.632198 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:25.638317 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:25.642941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:25.893676 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:25.915022 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a85b819e-e0a6-45ea-b44e-23819cd47355 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.381371 Oct 30 01:12:25.915022 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 165/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:25 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:26.958592 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:26.959441 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:26.972622 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:26.980103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:26.980103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:26.980103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:26.980103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:26.980727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:27.164185 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:27.175694 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6e4c27fe-6dea-4a64-9ac6-336b56386066 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.222570 Oct 30 01:12:27.175694 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 165/330] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:26 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:27.336460 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "84045b53-c3f3-4e09-83ce-c3ad8761f5c0", "create_info": {"type": "qcow2", "new_file": "volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.6ddec12a-d386-4e5e-b3cc-890a09362012.vhdx", "snapshot_id": "6ddec12a-d386-4e5e-b3cc-890a09362012"}}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:27.340142 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:27.340624 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:27.341049 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:27.353573 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:27.354053 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:27.354472 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:27.370904 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-990cd094-b507-4956-b6d3-3cbd9464d2aa req-f72a0dda-cc1f-4b2d-96c3-1a6f3f2e1ee9 admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.277367 Oct 30 01:12:27.377206 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 166/331] 10.222.0.61 () {64 vars in 1326 bytes} [Sun Oct 30 01:12:27 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:12:27.546208 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:27.548855 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:27.555929 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:27.556474 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:27.557137 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:27.557872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:27.558334 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:27.558812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:27.591325 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'flavor' on Instance uuid 56d6250d-ab71-49d8-843e-633f61eb9458 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:12:28.090412 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-cf529d81-ce9b-4f4c-b105-6e5d33f7d69f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/action" status: 200 len: 32 microversion: 2.1 time: 0.548225 Oct 30 01:12:28.091073 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 166/332] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:12:27 2022] POST /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/action => generated 32 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:12:28.103754 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:28.104440 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:28.112812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:28.113312 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:28.117494 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:28.117494 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:28.117494 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:28.117494 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:28.214460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:28.215197 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:28.231802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:28.232274 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:28.232722 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:28.237573 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:28.237573 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:28.237573 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:28.382407 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:28.395491 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-957c2f4a-5c05-490a-839d-4897c574549f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.295629 Oct 30 01:12:28.396919 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 167/333] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:28 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:28.478146 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:28.490468 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-47be2266-3fc2-4932-acb2-f3ce14382602 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.288136 Oct 30 01:12:28.491953 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 167/334] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:28 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:29.421147 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:29.424017 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:29.436067 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:29.436992 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:29.438305 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:29.440269 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:29.441473 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:29.442345 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:29.531807 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:29.534875 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:29.581235 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:29.590265 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:29.601116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:29.603097 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:29.606703 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:29.607529 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:29.713837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:29.734895 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-453c794a-2790-4357-986e-537a991bf5e0 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.318007 Oct 30 01:12:29.736970 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 168/335] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:29 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:29.936915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:29.952294 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-654300d1-3735-4227-a88f-b99f14d2da32 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.438741 Oct 30 01:12:29.953446 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 168/336] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:29 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:30.783378 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:30.784558 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:30.820152 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:30.836095 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:30.837023 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:30.838280 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:30.840674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:30.847047 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:30.997933 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:30.998964 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:31.037469 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:31.038317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:31.039064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:31.040901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:31.041791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:31.042460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:31.082967 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:31.195288 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:31.244776 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-75bf08ac-92ed-4838-86b8-745d50a38115 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.476892 Oct 30 01:12:31.252414 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 169/337] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:30 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:31.358192 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:31.381057 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ac78424c-0936-410b-9618-62d42100c3e1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.390847 Oct 30 01:12:31.388374 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 169/338] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:30 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:32.280811 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:32.280811 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:32.293846 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=26 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:32.301780 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:32.303348 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:32.304508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:32.306897 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:32.308114 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:32.309196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:32.414782 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:32.415485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:32.425054 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:32.427852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:32.428745 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:32.429450 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:32.430681 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:32.431835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:32.432723 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:32.997173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:33.011214 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:33.019160 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0617b0be-5f20-4db6-a825-f6059facc590 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1678 microversion: 2.1 time: 0.610899 Oct 30 01:12:33.020269 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 170/339] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:32 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1678 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:33.029357 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d7f078a7-b316-4420-8687-c7a0ceca6b1f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.763343 Oct 30 01:12:33.029957 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 170/340] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:32 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:33.125654 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "84045b53-c3f3-4e09-83ce-c3ad8761f5c0", "create_info": {"type": "qcow2", "new_file": "volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.d1e2df39-3ead-48d0-810c-9f849029c66e.vhdx", "snapshot_id": "d1e2df39-3ead-48d0-810c-9f849029c66e"}}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:33.135290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),981e4b1c-a815-41e8-a403-49a91c7c17f9(cell1) {{(pid=119524) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 30 01:12:33.135984 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:33.143295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:33.143295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:33.180093 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:33.180557 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:33.181135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:33.208339 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-8d17f677-3bf8-48e4-84f3-1d04d36d385f req-a4fad6fc-2cd2-4b6c-aeb4-9f152980a1ae admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.184863 Oct 30 01:12:33.209044 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 171/341] 10.222.0.61 () {64 vars in 1326 bytes} [Sun Oct 30 01:12:33 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:12:34.064787 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:34.065962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:34.078159 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:34.082758 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:34.105161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:34.107826 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:34.117935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:34.117935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:34.117935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:34.117935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:34.171271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:34.172401 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:34.175216 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:34.178888 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:34.187378 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:34.188531 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:34.703477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:34.716129 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-da3a7e69-f91b-4d3d-a91a-a93019619a06 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.659070 Oct 30 01:12:34.717183 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 171/342] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:34 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:34.741549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:34.752298 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-847ea7fc-8c35-4e07-98e4-2dcebda21308 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1655 microversion: 2.1 time: 0.692561 Oct 30 01:12:34.753304 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 172/343] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:34 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1655 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:34.779063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-da097451-7eaf-4ba0-8403-658ec14693e2 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:34.786228 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da097451-7eaf-4ba0-8403-658ec14693e2 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:34.786726 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da097451-7eaf-4ba0-8403-658ec14693e2 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:34.787169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-da097451-7eaf-4ba0-8403-658ec14693e2 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:34.819091 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-da097451-7eaf-4ba0-8403-658ec14693e2 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Going to try to start instance {{(pid=119523) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 01:12:35.099067 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-da097451-7eaf-4ba0-8403-658ec14693e2 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action" status: 202 len: 0 microversion: 2.1 time: 0.323648 Oct 30 01:12:35.103353 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 172/344] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:12:34 2022] POST /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:12:35.115155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:35.118494 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:35.141133 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:35.142527 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:35.146189 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:35.147331 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:35.148119 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:35.148909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:35.438329 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:35.450581 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2e3541ad-0d2c-4862-a878-ef0e5e11c129 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1664 microversion: 2.1 time: 0.343774 Oct 30 01:12:35.452095 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 173/345] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:35 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1664 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:35.762294 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:35.763537 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:35.785400 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:35.787261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:35.788143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:35.791565 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:35.792453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:35.793226 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:36.165377 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:36.167966 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:36.181481 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-160c1396-426c-4490-954f-7e1ab42f3b5d tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.429760 Oct 30 01:12:36.182511 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 173/346] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:35 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:36.481011 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:36.481791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:36.496080 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:36.497020 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:36.497826 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:36.500298 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:36.502186 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:36.502975 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:36.956155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:36.959920 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:36.960412 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:36.961146 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:36.973456 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:36.973456 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:36.973783 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:36.995129 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-a9e11589-2bdd-42d3-b2f2-f5426df123b2 req-d28f1490-d4d5-4fc4-abbf-4e6bfedcf47e admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/b7d2d715-599c-4b3b-a007-6c46c449096b?delete_info=%7B%22file_to_merge%22:%20%22volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.b7d2d715-599c-4b3b-a007-6c46c449096b.vhdx%22,%20%22volume_id%22:%20%2284045b53-c3f3-4e09-83ce-c3ad8761f5c0%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.241640 Oct 30 01:12:36.997921 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 174/347] 10.222.0.61 () {62 vars in 1800 bytes} [Sun Oct 30 01:12:36 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/b7d2d715-599c-4b3b-a007-6c46c449096b?delete_info=%7B%22file_to_merge%22:%20%22volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.b7d2d715-599c-4b3b-a007-6c46c449096b.vhdx%22,%20%22volume_id%22:%20%2284045b53-c3f3-4e09-83ce-c3ad8761f5c0%22%7D => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:12:37.025591 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:37.045644 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0fff2efa-cf61-4f2a-824b-b3b4a9ed1561 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1664 microversion: 2.1 time: 0.571733 Oct 30 01:12:37.059992 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 174/348] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:36 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1664 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:37.218474 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:37.218474 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:37.229518 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:37.230397 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:37.231184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:37.232562 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:37.233466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:37.234493 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:37.764438 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:37.774647 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-24cf4fec-d29a-4422-bd17-c8daf06392f7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.569925 Oct 30 01:12:37.775606 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 175/349] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:37 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:38.091809 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:38.094016 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:38.106417 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:38.107461 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:38.112717 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:38.112717 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:38.112717 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:38.112717 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:38.342709 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:38.351725 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2338cae5-6940-4b6d-a87b-78034f4aa292 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1668 microversion: 2.1 time: 0.267081 Oct 30 01:12:38.361808 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 175/350] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:38 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1668 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:38.810342 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:38.813277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:38.835627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:38.836513 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:38.837293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:38.838287 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:38.838944 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:38.839395 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:39.072536 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:39.082789 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7ce93252-5711-446c-ba75-778874c7a000 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.285868 Oct 30 01:12:39.083387 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 176/351] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:38 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:40.124863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:40.127831 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:40.141160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:40.141661 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:40.150541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:40.150541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:40.150541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:40.150541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:40.402621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:40.427407 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b712c3d5-02a4-469b-8d07-f3e091ae74ef tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.309593 Oct 30 01:12:40.428603 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 176/352] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:40 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:41.471888 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:41.475886 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:41.500172 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:41.502094 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:41.503052 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:41.504673 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:41.505960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:41.507220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:41.884606 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:41.904488 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3ffcdc26-e6e2-4969-95a1-173acd474a26 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.440095 Oct 30 01:12:41.906221 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 177/353] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:41 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:42.273103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:42.277389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:42.277895 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:42.278330 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:42.298971 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:42.302223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:42.302889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:42.328148 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-9e00b721-8d17-4a3b-80ff-1b1e5c286bc7 req-a6543abc-8e78-499f-a948-cd99eaab33b7 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d1e2df39-3ead-48d0-810c-9f849029c66e?delete_info=%7B%22file_to_merge%22:%20%22volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.d1e2df39-3ead-48d0-810c-9f849029c66e.vhdx%22,%20%22volume_id%22:%20%2284045b53-c3f3-4e09-83ce-c3ad8761f5c0%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.306425 Oct 30 01:12:42.329439 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 177/354] 10.222.0.61 () {62 vars in 1800 bytes} [Sun Oct 30 01:12:42 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d1e2df39-3ead-48d0-810c-9f849029c66e?delete_info=%7B%22file_to_merge%22:%20%22volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.d1e2df39-3ead-48d0-810c-9f849029c66e.vhdx%22,%20%22volume_id%22:%20%2284045b53-c3f3-4e09-83ce-c3ad8761f5c0%22%7D => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:12:42.936350 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:42.936350 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:42.948198 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:42.948975 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:42.949630 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:42.950568 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:42.951043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:42.951468 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:43.233650 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:43.245763 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8129523c-7bd6-4ced-b038-bfdf5bfce129 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1733 microversion: 2.1 time: 0.316774 Oct 30 01:12:43.246871 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 178/355] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:42 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1733 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:44.285585 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:44.287002 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:44.306403 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:44.310098 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:44.312830 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:44.314464 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:44.317488 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:44.318910 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:44.574702 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:44.592743 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-435233f5-27ca-4ea4-911b-50e9ebe4a120 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1713 microversion: 2.1 time: 0.314343 Oct 30 01:12:44.593846 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 178/356] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:44 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1713 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:12:45.085584 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:45.087036 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:45.095897 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:12:45.096308 dv-cinder-master-3-smb devstack@n-api.service[119523]: Sun Oct 30 01:12:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments/a26b00bf-a8dc-405e-a808-5384c38ac82d (ip 10.222.0.26) !!! Oct 30 01:12:45.098556 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:45.099265 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:45.099922 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:45.100853 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:45.101486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:45.102063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:45.307232 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] HTTP exception thrown: Cannot 'detach_volume' instance 56d6250d-ab71-49d8-843e-633f61eb9458 while it is in vm_state rescued Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Request method failure captured: Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: DELETE /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments/a26b00bf-a8dc-405e-a808-5384c38ac82d HTTP/1.1 Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc69huK0SDLXJgmIyu6BPqSYLCVEyIe9cHnN98C6O0bg_C7P_g7RJWF5daFRmnsRL19ij5JAK_vjEApIvbFGQlCjV-KCkLe9-zN-5krIMF7R5TTcyZppp7pWvZDYocAh55uvA4MKS4HDcGpFMmPnKZahm2375jZeXhgkqsq8CtjGUsI Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:12:45.309241 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: a4a4230574c846a9b4f7edd240317ee9 Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:12:45.312419 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Cannot 'detach_volume' instance 56d6250d-ab71-49d8-843e-633f61eb9458 while it is in vm_state rescued Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'server_id': '56d6250d-ab71-49d8-843e-633f61eb9458', 'id': 'a26b00bf-a8dc-405e-a808-5384c38ac82d'} Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56d6250d-ab71-49d8-843e-633f61eb9458 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:12:45.314544 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 56d6250d-ab71-49d8-843e-633f61eb9458 while it is in vm_state rescued Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 56d6250d-ab71-49d8-843e-633f61eb9458 while it is in vm_state rescued Oct 30 01:12:45.317093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:12:45.324467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Returning 409 to user: Cannot 'detach_volume' instance 56d6250d-ab71-49d8-843e-633f61eb9458 while it is in vm_state rescued {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:12:45.325801 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6c9cebc9-bb66-47c0-aba3-fb7ad29c1064 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "DELETE /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments/a26b00bf-a8dc-405e-a808-5384c38ac82d" status: 409 len: 152 microversion: 2.1 time: 0.242329 Oct 30 01:12:45.327295 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 179/357] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:12:45 2022] DELETE /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments/a26b00bf-a8dc-405e-a808-5384c38ac82d => generated 152 bytes in 246 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:12:45.340020 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:45.340020 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:45.345673 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:45.346468 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:45.346989 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:45.347851 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:45.348397 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:45.348916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:45.687734 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a940ca2c-7c1d-4a33-8718-bd6152564f5f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "POST /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/action" status: 202 len: 0 microversion: 2.1 time: 0.354596 Oct 30 01:12:45.704206 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 179/358] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:12:45 2022] POST /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:12:45.704620 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:45.704620 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:45.711308 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:45.711899 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:45.712723 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:45.713457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:45.713938 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:45.714343 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:46.015438 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:46.034827 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6e5c005d-7588-484d-babb-37464178b37a tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1721 microversion: 2.1 time: 0.340420 Oct 30 01:12:46.035974 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 180/359] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:45 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:47.068541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:47.071875 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:47.085856 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:47.086528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:47.089448 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:47.090659 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:47.091316 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:47.092734 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:47.365379 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:47.393244 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9ccf8f20-4f4a-49c3-88bb-96036d4cab66 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1721 microversion: 2.1 time: 0.331694 Oct 30 01:12:47.396280 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 180/360] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:47 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:47.676168 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:47.895060 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:47.898735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:47.900173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:47.900173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:47.910346 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:47.910853 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:47.911354 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:47.937828 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-04573962-6014-4ab4-9c32-797bafac24e1 req-14718f27-8561-41b9-84c1-6b42bd434119 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/6ddec12a-d386-4e5e-b3cc-890a09362012?delete_info=%7B%22file_to_merge%22:%20%22volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.6ddec12a-d386-4e5e-b3cc-890a09362012.vhdx%22,%20%22volume_id%22:%20%2284045b53-c3f3-4e09-83ce-c3ad8761f5c0%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.288750 Oct 30 01:12:47.939365 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 181/361] 10.222.0.61 () {62 vars in 1800 bytes} [Sun Oct 30 01:12:47 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/6ddec12a-d386-4e5e-b3cc-890a09362012?delete_info=%7B%22file_to_merge%22:%20%22volume-84045b53-c3f3-4e09-83ce-c3ad8761f5c0.6ddec12a-d386-4e5e-b3cc-890a09362012.vhdx%22,%20%22volume_id%22:%20%2284045b53-c3f3-4e09-83ce-c3ad8761f5c0%22%7D => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:12:48.444981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:48.448498 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:48.467675 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:48.473236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:48.474294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:48.475849 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:48.479798 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:48.480812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:48.787684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:48.798862 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-34b5f02d-c868-45e9-9310-fc961044cfec tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1721 microversion: 2.1 time: 0.365840 Oct 30 01:12:48.799720 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 181/362] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:48 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:49.849220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:49.852050 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:49.895784 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:49.900664 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:49.901820 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:49.907978 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:49.909175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:49.909960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:50.151748 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:50.175916 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0ce677d4-7fb4-4595-bedd-34ed564766ba tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1727 microversion: 2.1 time: 0.336102 Oct 30 01:12:50.178022 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 182/363] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:49 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1727 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:50.221892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:50.223155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:50.236948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:50.238387 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:50.241188 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:50.241954 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:50.242602 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:50.245412 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:50.440141 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-60ec20cb-fd36-406a-ad2a-225d67bf874c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222579 Oct 30 01:12:50.441910 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 182/364] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:12:50 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:12:51.784970 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:51.789424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:51.812844 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:51.819725 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:51.820903 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:51.823982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:51.823982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:51.829021 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:52.152471 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lazy-loading 'services' on Instance uuid d0060d3a-0447-440d-9a30-3d194419de58 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:12:52.581048 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-09be5918-b5fc-4d22-8f18-ec88afaf7a38 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58/os-volume_attachments/84045b53-c3f3-4e09-83ce-c3ad8761f5c0" status: 202 len: 0 microversion: 2.1 time: 0.803235 Oct 30 01:12:52.582837 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 183/365] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:12:51 2022] DELETE /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58/os-volume_attachments/84045b53-c3f3-4e09-83ce-c3ad8761f5c0 => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:12:53.272084 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-b03540c8-efea-4eec-a7d8-35c6f0356811 req-986eed87-949c-4afa-9c0b-32a75361e789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d6250d-ab71-49d8-843e-633f61eb9458", "tag": "a670959f-9524-4528-b199-1b19260d3767"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:53.297115 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=4 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:53.299742 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-b03540c8-efea-4eec-a7d8-35c6f0356811 req-986eed87-949c-4afa-9c0b-32a75361e789 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:53.300356 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-b03540c8-efea-4eec-a7d8-35c6f0356811 req-986eed87-949c-4afa-9c0b-32a75361e789 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:53.300761 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-b03540c8-efea-4eec-a7d8-35c6f0356811 req-986eed87-949c-4afa-9c0b-32a75361e789 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:53.376759 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-b03540c8-efea-4eec-a7d8-35c6f0356811 req-986eed87-949c-4afa-9c0b-32a75361e789 service nova] Creating event network-changed:a670959f-9524-4528-b199-1b19260d3767 for instance 56d6250d-ab71-49d8-843e-633f61eb9458 on hv-cinder-maste Oct 30 01:12:53.418039 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-b03540c8-efea-4eec-a7d8-35c6f0356811 req-986eed87-949c-4afa-9c0b-32a75361e789 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147240 Oct 30 01:12:53.439650 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 183/366] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:12:55.178572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:55.191000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:55.214650 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:55.216321 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:55.217731 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:55.219949 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:55.221219 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:55.222491 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:55.271205 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:12:55.451345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-430faa96-7da6-4bd2-ad64-62168f5effc2 req-eaf53e1e-7aa5-41f8-b663-cf4131d02a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d6250d-ab71-49d8-843e-633f61eb9458", "tag": "a670959f-9524-4528-b199-1b19260d3767"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:12:55.476156 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-430faa96-7da6-4bd2-ad64-62168f5effc2 req-eaf53e1e-7aa5-41f8-b663-cf4131d02a38 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:55.478253 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-430faa96-7da6-4bd2-ad64-62168f5effc2 req-eaf53e1e-7aa5-41f8-b663-cf4131d02a38 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:55.478253 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-430faa96-7da6-4bd2-ad64-62168f5effc2 req-eaf53e1e-7aa5-41f8-b663-cf4131d02a38 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:55.508585 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-430faa96-7da6-4bd2-ad64-62168f5effc2 req-eaf53e1e-7aa5-41f8-b663-cf4131d02a38 service nova] Creating event network-changed:a670959f-9524-4528-b199-1b19260d3767 for instance 56d6250d-ab71-49d8-843e-633f61eb9458 on hv-cinder-maste Oct 30 01:12:55.515825 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-430faa96-7da6-4bd2-ad64-62168f5effc2 req-eaf53e1e-7aa5-41f8-b663-cf4131d02a38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071856 Oct 30 01:12:55.518733 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 184/367] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:12:55.818408 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-680bcc97-06b8-4578-853c-4dfbf09ff599 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 204 len: 0 microversion: 2.1 time: 0.652226 Oct 30 01:12:55.819816 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 184/368] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:12:55 2022] DELETE /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:12:55.845239 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:55.846470 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:55.861105 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:55.862409 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:55.864369 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:55.866294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:55.867388 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:55.870317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:56.076897 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:56.088415 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-95b8f834-3366-480c-9078-1f37658e1b72 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1514 microversion: 2.1 time: 0.257833 Oct 30 01:12:56.089497 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 185/369] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:55 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:57.118555 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:57.119951 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:57.128636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:57.129422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:57.130193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:57.131376 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:57.132316 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:57.133049 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:57.342642 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:57.358811 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ec55612e-41e0-4be9-9457-3b180601e53f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1514 microversion: 2.1 time: 0.243947 Oct 30 01:12:57.369774 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 185/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:57 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:58.392980 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:58.394017 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:58.403945 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:58.404571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:58.405125 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:58.405984 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:58.407778 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:58.408349 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:58.567762 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:58.576002 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-02d52419-38c7-4cbf-a978-a7f1f824892b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1514 microversion: 2.1 time: 0.187493 Oct 30 01:12:58.576587 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 186/371] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:58 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:12:59.604712 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:12:59.605571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:12:59.607356 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:59.614533 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:59.615043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:59.615474 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:59.616262 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:59.616727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:59.617154 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:59.799425 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:12:59.811375 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c1085657-f624-4a1a-9ef8-b94ee7592fb8 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1514 microversion: 2.1 time: 0.209751 Oct 30 01:12:59.824434 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 186/372] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:12:59 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:00.835342 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:00.836252 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:00.848938 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:00.852946 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:00.855851 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:00.856638 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:00.857814 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:00.858729 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:01.190880 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:01.202580 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1144ba2a-e463-4dc4-b0a4-a6c01c0e1a42 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1514 microversion: 2.1 time: 0.371035 Oct 30 01:13:01.204567 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 187/373] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:00 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:01.738911 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-048e994a-4c0b-41d1-ae9d-085cc2fd842d req-4180dafa-0078-4585-ab85-129993f58c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0060d3a-0447-440d-9a30-3d194419de58", "name": "network-vif-deleted", "tag": "703d5b5a-5333-40f3-b279-7fd21ceb03d3"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:01.752594 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-048e994a-4c0b-41d1-ae9d-085cc2fd842d req-4180dafa-0078-4585-ab85-129993f58c6a service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:01.753364 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-048e994a-4c0b-41d1-ae9d-085cc2fd842d req-4180dafa-0078-4585-ab85-129993f58c6a service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:01.754061 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-048e994a-4c0b-41d1-ae9d-085cc2fd842d req-4180dafa-0078-4585-ab85-129993f58c6a service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:01.773265 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-048e994a-4c0b-41d1-ae9d-085cc2fd842d req-4180dafa-0078-4585-ab85-129993f58c6a service nova] Creating event network-vif-deleted:703d5b5a-5333-40f3-b279-7fd21ceb03d3 for instance d0060d3a-0447-440d-9a30-3d194419de58 on hv-cinder-maste Oct 30 01:13:01.778725 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-048e994a-4c0b-41d1-ae9d-085cc2fd842d req-4180dafa-0078-4585-ab85-129993f58c6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044512 Oct 30 01:13:01.779347 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 187/374] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:02.247844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:02.272453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:02.272453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:02.272453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:02.272453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:02.272874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:02.272874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:02.272874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:02.272874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:02.297174 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:02.297671 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:02.298101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:02.298551 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lazy-loading 'fault' on Instance uuid d0060d3a-0447-440d-9a30-3d194419de58 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:02.341808 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:02.350872 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2fc7040c-2119-4f4a-8017-188a1888866a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1309 microversion: 2.1 time: 0.108875 Oct 30 01:13:02.351470 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 188/375] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:02 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:03.380152 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:03.382682 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:03.385655 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:03.395222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:03.396858 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:03.397768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:03.398776 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:03.399383 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:03.400021 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:03.448429 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:03.448994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:03.449430 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:03.449898 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lazy-loading 'fault' on Instance uuid d0060d3a-0447-440d-9a30-3d194419de58 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:03.497803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:03.506540 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-579e35fe-b05b-43b3-afe7-50652a46f251 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 200 len: 1309 microversion: 2.1 time: 0.134502 Oct 30 01:13:03.507488 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 188/376] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:03 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:04.042392 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-38fffaab-1554-4d22-a1b3-c7f00a5437df tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Action: 'create', calling method: .version_select at 0x7f048c035040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2051045956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+B2IYYTVnwXqS4Th8qqAlIE+oJZpWuRWz8qV4GbRlgM5hw3HpazjyXLe+ZkQShG0uaNtZyRa4nC/JAq4WvYtRaS9sBpxtm53P9atx/z7L1Y5t2Uhfgd0TUFtbpal1fPg=="}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:04.063417 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-38fffaab-1554-4d22-a1b3-c7f00a5437df tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Getting quotas for project 77968fc2b85349b2a625ea9bf25cd026. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:13:04.068400 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-38fffaab-1554-4d22-a1b3-c7f00a5437df tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Getting quotas for user efbfd82026f14adb91bead1b95154448 and project 77968fc2b85349b2a625ea9bf25cd026. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:13:04.172907 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-38fffaab-1554-4d22-a1b3-c7f00a5437df tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.135030 Oct 30 01:13:04.173535 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 189/377] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:13:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:04.326516 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1669406097", "imageRef": "ece4bbe2-8d81-4082-801e-b88db075375a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2051045956", "networks": [{"uuid": "18b95593-51bf-430c-b604-7f9c27dddbdb"}]}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:04.402897 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] validate_networks() for [('18b95593-51bf-430c-b604-7f9c27dddbdb', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:13:04.535997 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:04.537129 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: d0060d3a-0447-440d-9a30-3d194419de58] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:04.540696 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:04.548715 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:04.552604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:04.552604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:04.552604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:04.553004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:04.553799 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:04.581982 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] HTTP exception thrown: Instance d0060d3a-0447-440d-9a30-3d194419de58 could not be found. Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Request method failure captured: Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 HTTP/1.1 Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc83nQk29WHTzKZsVahVxLmJDIRWvW7-R9zuOsztGPuGygmAwvODsIoX7HUGTpAlLa5ExAyl8VN7ZfW6hcrQV9KWf54jXWdK4JHNrxnCLf7cOgGxNngHXzLoFgRAeFQ6dW0gkInug9X6iJIu0D7CHcum4yU-zntJo5s5RKWeoOaof6M Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: ec0e8d209ae34edca0d7dc5dae71129a Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1480960158 Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:13:04.585493 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesSnapshotTestJSON-1480960158 Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: ec0e8d209ae34edca0d7dc5dae71129a Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1480960158 Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesSnapshotTestJSON-1480960158-project Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 9254fc77e32147fdb3a28422b8458039 Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesSnapshotTestJSON-1480960158-project Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance d0060d3a-0447-440d-9a30-3d194419de58 could not be found. Oct 30 01:13:04.594375 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'd0060d3a-0447-440d-9a30-3d194419de58'} Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0060d3a-0447-440d-9a30-3d194419de58 could not be found. Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:04.595883 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0060d3a-0447-440d-9a30-3d194419de58 could not be found. Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0060d3a-0447-440d-9a30-3d194419de58 could not be found. Oct 30 01:13:04.598187 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:04.600487 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Returning 404 to user: Instance d0060d3a-0447-440d-9a30-3d194419de58 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:04.600487 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9c98759c-1865-40e7-a034-6c9a0a6340e0 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58" status: 404 len: 111 microversion: 2.1 time: 0.061164 Oct 30 01:13:04.600487 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 190/378] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:04 2022] GET /compute/v2.1/servers/d0060d3a-0447-440d-9a30-3d194419de58 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:13:04.940099 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:13:04.940860 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:13:04.941694 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:13:04.942648 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:13:04.943520 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:13:04.956477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:04.956965 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:04.957402 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:04.958137 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:04.958645 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:04.959075 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:04.978778 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Getting quotas for project 77968fc2b85349b2a625ea9bf25cd026. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:13:04.983607 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Getting quotas for user efbfd82026f14adb91bead1b95154448 and project 77968fc2b85349b2a625ea9bf25cd026. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:13:04.997180 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:13:04.999579 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ece4bbe2-8d81-4082-801e-b88db075375a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:13:05.128229 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d8e7daa6-1994-4d9f-add6-95a311e2562f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805873 Oct 30 01:13:05.129194 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 189/379] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:13:05.147077 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a3305084-1272-47bd-8cae-0c91bb7bfcf9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:05.148187 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a3305084-1272-47bd-8cae-0c91bb7bfcf9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:05.232995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a3305084-1272-47bd-8cae-0c91bb7bfcf9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:05.242463 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a3305084-1272-47bd-8cae-0c91bb7bfcf9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1259 microversion: 2.1 time: 0.104207 Oct 30 01:13:05.243708 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 191/380] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:05 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1259 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:06.271526 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cfe38d47-f18e-42ae-8755-caa3d0205c64 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:06.272185 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-cfe38d47-f18e-42ae-8755-caa3d0205c64 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:06.330980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cfe38d47-f18e-42ae-8755-caa3d0205c64 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:06.342917 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-cfe38d47-f18e-42ae-8755-caa3d0205c64 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1259 microversion: 2.1 time: 0.075583 Oct 30 01:13:06.345627 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 190/381] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:06 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:07.374181 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:07.375864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:07.383859 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:07.384509 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:07.384795 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:07.385589 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:07.386055 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:07.386522 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:07.459894 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:07.473063 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3724b666-299f-4ab4-9c24-49b4215f0e35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1311 microversion: 2.1 time: 0.106077 Oct 30 01:13:07.477775 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 192/382] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:07 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:08.498822 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:08.499530 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:08.507137 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:08.507732 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:08.508205 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:08.509104 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:08.509595 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:08.510063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:08.517802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:08.635162 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:08.645417 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-72890d56-82c2-4cfe-aa67-e3c878676b2f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1329 microversion: 2.1 time: 0.150850 Oct 30 01:13:08.646300 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 191/383] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:08 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1329 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:09.374623 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-907600802", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "networks": [{"uuid": "32880eeb-e493-4688-8da8-8b7c1a83fec5"}]}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:09.479901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] validate_networks() for [('32880eeb-e493-4688-8da8-8b7c1a83fec5', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:13:09.675994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:09.677939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:09.692296 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:09.693252 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:09.694375 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:09.695160 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:09.695941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:09.696936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:10.001428 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:10.010856 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8c0d48f9-95c9-4239-9d1f-163c06efb20d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.340409 Oct 30 01:13:10.011507 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 192/384] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:09 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:10.368960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:13:10.369777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:13:10.370892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:13:10.371908 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:13:10.372708 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:13:10.386210 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:10.387279 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:10.387279 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:10.387918 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:10.388381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:10.388806 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:10.410990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Getting quotas for project ec0e8d209ae34edca0d7dc5dae71129a. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:13:10.416229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Getting quotas for user 9254fc77e32147fdb3a28422b8458039 and project ec0e8d209ae34edca0d7dc5dae71129a. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:13:10.431288 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:13:10.434078 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:13:10.601837 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a20f080f-b2e5-48d3-8370-ff867ae200d9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231123 Oct 30 01:13:10.603275 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 193/385] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:13:10.619758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7330eb89-f08d-41c1-bb54-612be21032c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:10.620798 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7330eb89-f08d-41c1-bb54-612be21032c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:10.711294 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7330eb89-f08d-41c1-bb54-612be21032c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:10.721199 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7330eb89-f08d-41c1-bb54-612be21032c4 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1218 microversion: 2.1 time: 0.109223 Oct 30 01:13:10.723551 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 193/386] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:10 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:11.037120 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:11.039497 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:11.049359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:11.049899 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:11.050340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:11.051074 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:11.051534 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:11.051990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:11.262597 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:11.276177 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9817e3ce-27cc-40c3-8c34-3537173c5910 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.244293 Oct 30 01:13:11.291626 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 194/387] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:11 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:11.749289 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:11.751460 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:11.766021 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:11.766692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:11.767164 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:11.768136 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:11.768719 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:11.769207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:11.872139 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:11.880694 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4538c298-2ca4-4054-9b15-92db39d32e06 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1222 microversion: 2.1 time: 0.138830 Oct 30 01:13:11.881283 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 194/388] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:11 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:12.321814 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:12.322633 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:12.330746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:12.331558 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:12.332197 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:12.333486 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:12.334226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:12.334937 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:12.531784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:12.545040 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8309ce10-5b11-45b5-8f18-30490444e90e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.229330 Oct 30 01:13:12.546275 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 195/389] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:12 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:12.920678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:12.921539 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:12.929072 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:12.929837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:12.930271 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:12.931052 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:12.931440 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:12.932058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:13.023636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:13.033289 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-76efbcf0-f3f2-4f99-a059-37f7ab5cce48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1222 microversion: 2.1 time: 0.117169 Oct 30 01:13:13.036053 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 195/390] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:12 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:13.591071 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:13.592257 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:13.601231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:13.601976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:13.602588 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:13.603798 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:13.604426 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:13.604998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:13.818960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:13.833730 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4e1e3e08-7156-4942-8623-ccc3c0d6547b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.248655 Oct 30 01:13:13.835035 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 196/391] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:13 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:14.072476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:14.073251 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:14.092704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:14.093605 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:14.094384 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:14.095753 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:14.096609 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:14.097358 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:14.233653 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:14.246385 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-082033fb-97b1-4c2c-a820-37dbd8f5cb45 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1222 microversion: 2.1 time: 0.178228 Oct 30 01:13:14.247137 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 196/392] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:14 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:14.858791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:14.861676 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:14.875229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:14.875981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:14.876620 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:14.877525 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:14.878183 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:14.878879 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:15.073906 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:15.087459 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e66f3335-7ba7-4e71-82ce-cf09513bacd6 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.232736 Oct 30 01:13:15.092387 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 197/393] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:14 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:15.274974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:15.277819 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:15.285926 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:15.289176 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:15.289662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:15.290122 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:15.290838 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:15.291330 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:15.291783 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:15.397592 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:15.408032 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3eb1f7b0-1b13-40c0-8724-a95a74f46933 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1222 microversion: 2.1 time: 0.138356 Oct 30 01:13:15.410327 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 197/394] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:15 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:16.125987 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:16.128341 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:16.143511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.144830 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.145678 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.146842 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.147723 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.148505 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.387840 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:16.399290 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4e65769b-1525-4c1c-a064-8027c19e4946 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.283205 Oct 30 01:13:16.400132 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 198/395] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:16 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:16.448570 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:16.449637 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:16.462556 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.463462 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.464268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.465733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.466354 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.467089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.604089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:16.620664 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e2a53247-e637-4886-952a-1d1ab8922736 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1222 microversion: 2.1 time: 0.177887 Oct 30 01:13:16.624274 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 198/396] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:16 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:16.731525 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:16.736221 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:16.747439 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.748677 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.750184 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.751347 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.752226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.752998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.809042 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1032858d-8ca3-4fb4-b9ab-670dab812b9d tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084975 Oct 30 01:13:16.813567 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 199/397] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:13:16 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:16.909664 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:16.910251 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:16.917033 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.917534 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.918043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.918781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:16.919245 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:16.919720 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:16.954027 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:13:17.302871 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a082208a-5afe-4a43-bcfd-92b29932059e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 204 len: 0 microversion: 2.1 time: 0.397466 Oct 30 01:13:17.304570 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 199/398] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:13:16 2022] DELETE /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:13:17.317078 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:17.317695 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:17.325127 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:17.325722 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:17.326171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:17.326950 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:17.327403 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:17.327869 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:17.456964 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:17.458457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:17.471849 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:17.472749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:17.473699 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:17.475781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:17.477379 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:17.477846 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:17.521069 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:17.538643 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e0c7a805-cadf-41df-a988-b93243440f29 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1674 microversion: 2.1 time: 0.228503 Oct 30 01:13:17.540820 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 200/399] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:17 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:17.650831 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:17.651943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:17.660990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:17.661829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:17.662389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:17.663347 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:17.663984 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:17.664526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:17.779705 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:17.788601 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:17.795374 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9dae8edf-0e4e-4850-a3cb-86ed13b3f606 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1222 microversion: 2.1 time: 0.151439 Oct 30 01:13:17.802934 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 201/400] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:17 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:17.803170 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-679689c2-f88d-441d-90d3-7c69d174df35 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.350870 Oct 30 01:13:17.803170 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 200/401] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:17 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:18.569292 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:18.570299 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:18.582903 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:18.583806 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:18.584592 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:18.585587 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:18.586371 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:18.587140 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:18.824609 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:18.825692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:18.836436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:18.837209 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:18.838248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:18.839502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:18.840391 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:18.841387 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:18.875215 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:18.890678 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e9567115-617b-4f56-8840-578021bd3fa9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1674 microversion: 2.1 time: 0.326581 Oct 30 01:13:18.892095 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 202/402] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:18 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1674 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:18.901520 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:18.903025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:18.914463 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:18.915890 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:18.916915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:18.918626 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:18.919805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:18.920853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:19.037368 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:19.047795 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d10ab584-3576-43c6-bd89-25e56b9346bd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1214 microversion: 2.1 time: 0.153707 Oct 30 01:13:19.048599 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 203/403] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:18 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:19.120477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:19.129220 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9b76ed06-b74b-49a8-a510-a6cda3c581d2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.309577 Oct 30 01:13:19.129938 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 201/404] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:18 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:19.756493 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-fa875cf6-5fb8-42b7-b345-d2bac778cf56 req-70a3b805-6d52-490b-966d-fbd8c4f69cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6eed76-f803-4a8e-8890-5d899eca8800", "tag": "4e38f9d6-0235-42f8-8ef7-c7a4b4344058"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:19.769313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-fa875cf6-5fb8-42b7-b345-d2bac778cf56 req-70a3b805-6d52-490b-966d-fbd8c4f69cfd service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:19.774114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-fa875cf6-5fb8-42b7-b345-d2bac778cf56 req-70a3b805-6d52-490b-966d-fbd8c4f69cfd service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:19.774114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-fa875cf6-5fb8-42b7-b345-d2bac778cf56 req-70a3b805-6d52-490b-966d-fbd8c4f69cfd service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:19.786970 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-fa875cf6-5fb8-42b7-b345-d2bac778cf56 req-70a3b805-6d52-490b-966d-fbd8c4f69cfd service nova] Creating event network-changed:4e38f9d6-0235-42f8-8ef7-c7a4b4344058 for instance 7a6eed76-f803-4a8e-8890-5d899eca8800 on hv-cinder-maste Oct 30 01:13:19.794543 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-fa875cf6-5fb8-42b7-b345-d2bac778cf56 req-70a3b805-6d52-490b-966d-fbd8c4f69cfd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042899 Oct 30 01:13:19.795909 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 204/405] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:19.930667 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:19.931561 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:19.939242 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:19.939857 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:19.940290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:19.940999 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:19.941458 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:19.941876 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:20.075422 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:20.076443 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:20.084505 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:20.085165 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:20.085905 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:20.086691 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:20.087376 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:20.087925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:20.088830 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:20.099267 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d068714f-6eb2-4acb-b22a-c1687b6aa0dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1674 microversion: 2.1 time: 0.172935 Oct 30 01:13:20.100019 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 202/406] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:19 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:20.167067 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:20.167943 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:20.174606 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:20.178811 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:20.179350 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:20.179815 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:20.180529 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:20.181081 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:20.181448 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:20.189709 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ae20d146-3a93-4e68-a457-475e8a3e7cbd tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1214 microversion: 2.1 time: 0.118342 Oct 30 01:13:20.190978 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 205/407] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:20 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:20.354347 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:20.368147 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5058ef74-f611-4bad-ac2f-0d1cb1aba227 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.204716 Oct 30 01:13:20.369515 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 203/408] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:20 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:21.140140 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:21.142547 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:21.148168 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:21.150856 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=12 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:21.159064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:21.161740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:21.161740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:21.162998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:21.164158 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:21.165352 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:21.329974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:21.329974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:21.338248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=10 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:21.341008 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:21.342727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:21.344922 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:21.346727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:21.347363 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:21.347971 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:21.587671 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:21.587827 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:21.587943 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-83a3a298-3c05-43b7-9899-23f419aa2299 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1674 microversion: 2.1 time: 0.422065 Oct 30 01:13:21.587943 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 206/409] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:21 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1674 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:21.588198 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5c2628c6-accd-4b6a-bdf3-c54b5bdafb5a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1270 microversion: 2.1 time: 0.257621 Oct 30 01:13:21.588425 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:21.588564 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 204/410] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:21 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1270 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:21.588687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:21.588687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:21.588687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:21.589182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:21.590584 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:21.591512 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:21.592369 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:21.980377 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:21.980377 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6eb5cfc8-09c5-4550-adf4-25cd93122cfa tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.408973 Oct 30 01:13:21.984787 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 207/411] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:21 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:22.591074 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:22.591823 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:22.600469 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.601037 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.601533 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.602480 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.602984 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.603654 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.604566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:22.605748 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:22.618159 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.619378 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.619923 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.621250 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.622138 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.622941 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.649941 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=100 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.755939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:22.774049 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6158d7a4-7288-4aba-81bb-6c9850a30894 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1278 microversion: 2.1 time: 0.186755 Oct 30 01:13:22.783038 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:22.787230 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 205/412] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:22 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:22.798877 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-94e409cf-8ab4-49e2-a60d-adc10b1db6ff tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1607 microversion: 2.1 time: 0.202333 Oct 30 01:13:22.800035 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 208/413] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:22 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1607 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:22.995435 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:22.996496 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:23.005394 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.006238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.006845 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.007814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.008516 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.009244 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.155044 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-2226435f-9db3-40b2-9e06-d9fea590f337 req-1553a25a-ea37-48ff-ac39-10f7cc5ea4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb", "name": "network-vif-deleted", "tag": "e110a9e6-b871-4b2d-8aa2-faebc5bffc4d"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:23.177976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-2226435f-9db3-40b2-9e06-d9fea590f337 req-1553a25a-ea37-48ff-ac39-10f7cc5ea4e9 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.178933 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-2226435f-9db3-40b2-9e06-d9fea590f337 req-1553a25a-ea37-48ff-ac39-10f7cc5ea4e9 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.179914 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-2226435f-9db3-40b2-9e06-d9fea590f337 req-1553a25a-ea37-48ff-ac39-10f7cc5ea4e9 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.207055 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-2226435f-9db3-40b2-9e06-d9fea590f337 req-1553a25a-ea37-48ff-ac39-10f7cc5ea4e9 service nova] Creating event network-vif-deleted:e110a9e6-b871-4b2d-8aa2-faebc5bffc4d for instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb on hv-cinder-maste Oct 30 01:13:23.217638 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-2226435f-9db3-40b2-9e06-d9fea590f337 req-1553a25a-ea37-48ff-ac39-10f7cc5ea4e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069782 Oct 30 01:13:23.218917 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 209/414] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:23.239994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:23.255020 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5c27f183-7619-4126-9024-5680a4d58113 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.264426 Oct 30 01:13:23.256413 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 206/415] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:22 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:23.814109 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:23.815682 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:23.832181 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.832924 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.834783 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.837663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.839227 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.839502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:23.842622 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:23.846404 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.869429 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.869429 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.872779 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.875716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.876462 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.877856 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.889888 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:24.063467 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:24.080555 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:24.081899 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-95b553d7-a68e-41da-9fd3-b5a75257d2a6 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1288 microversion: 2.1 time: 0.272517 Oct 30 01:13:24.082472 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 210/416] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:23 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1288 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:24.104107 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-03d3ed84-e057-492b-adf7-0890dd663797 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1322 microversion: 2.1 time: 0.270837 Oct 30 01:13:24.105550 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 207/417] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:23 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:24.298448 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:24.299500 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:24.326507 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:24.330844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:24.332621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:24.339859 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:24.339859 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:24.342540 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:24.797222 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:24.811352 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1ed2108a-9c09-4ba3-bb18-04fc30ae49fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.519825 Oct 30 01:13:24.813931 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 211/418] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:24 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:25.112929 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:25.115185 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:25.133158 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.134634 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.135854 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.138545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.140478 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.144979 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:25.145807 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:25.146245 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.157051 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.157861 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.158690 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.159810 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.160470 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.161107 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.261857 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.268245 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.271777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.272563 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lazy-loading 'fault' on Instance uuid 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:25.333630 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:25.350106 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-05ec56ba-b953-490d-af68-f55066c33b8f tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1276 microversion: 2.1 time: 0.243681 Oct 30 01:13:25.362711 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 208/419] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:25 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:25.404075 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:25.422735 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-52986fae-65d6-4ec3-9622-9be1755c2738 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 200 len: 1327 microversion: 2.1 time: 0.283818 Oct 30 01:13:25.427362 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 212/420] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:25 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 1327 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:25.631127 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:25.633040 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:25.644988 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.645871 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.646671 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.648091 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.648949 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.649716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.777883 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'services' on Instance uuid 56d6250d-ab71-49d8-843e-633f61eb9458 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:25.853130 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:25.854430 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:25.866359 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.867956 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.868731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.869977 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.870798 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.871556 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.076938 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-588dcac6-b1bc-49c3-bc99-ad5723bb230b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "DELETE /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments/a26b00bf-a8dc-405e-a808-5384c38ac82d" status: 202 len: 0 microversion: 2.1 time: 0.453457 Oct 30 01:13:26.078731 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 209/421] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:13:25 2022] DELETE /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments/a26b00bf-a8dc-405e-a808-5384c38ac82d => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:26.114554 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:26.122921 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:26.134141 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.134981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.135775 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.136976 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.137801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.138568 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.200569 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e5e69d9b-983a-499c-9727-65b1ececb0eb tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103742 Oct 30 01:13:26.203367 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 210/422] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:13:26 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:26.272388 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:26.283075 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-aeff9944-d616-40b4-a786-b2bd975f3e59 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.437170 Oct 30 01:13:26.283875 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 213/423] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:25 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:26.394342 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:26.394960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:26.401516 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.402577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.403022 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.403824 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.404289 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.404713 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.466059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:26.467242 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:26.484076 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.485428 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.486198 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.487518 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.488662 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.489434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.516447 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] HTTP exception thrown: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Request method failure captured: Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb HTTP/1.1 Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc7CD7EHvBHo9qW3H8Z8zKDxoCKCQXT1g2b9pP-MlnW7KPdBb5dVBwCpnevNv5jI5x6r1h0bJi2mMs8n1xbvFrrzFoZMa_-BvqaBkyRX722kqEhJYZUhUIVe_XUv2pW55Nv29HjLEniZYCCuP9Of0WG0-pMG9wzSuYN9ECTyBCos3E4 Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:13:26.518305 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 2cfba439a18a4c8e8fa0021380128447 Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:13:26.526824 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb'} Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:26.528722 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:13:26.531859 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.534146 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Returning 404 to user: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:26.534146 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fde416f3-7de3-4563-8a1b-ecbb6da59c40 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 404 len: 111 microversion: 2.1 time: 0.062433 Oct 30 01:13:26.534146 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 214/424] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:26 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:13:26.535443 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4610e8f5-aaf5-4786-ac97-c9ab46f4a828 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '.version_select at 0x7f048cdad9d0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:26.613196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:26.623396 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bb8b1c4d-625a-4aae-b08d-06647bef18ad tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.233960 Oct 30 01:13:26.625068 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 211/425] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:26 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:26.733841 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4610e8f5-aaf5-4786-ac97-c9ab46f4a828 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224960574" status: 202 len: 0 microversion: 2.1 time: 0.205579 Oct 30 01:13:26.736110 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 215/426] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 30 01:13:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224960574 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:13:26.774563 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-0d2a9930-6c4d-4c17-a014-3295fd5713b3 req-e057998a-bcb7-408d-9596-12e24a4e03a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6eed76-f803-4a8e-8890-5d899eca8800", "name": "network-vif-plugged", "status": "completed", "tag": "4e38f9d6-0235-42f8-8ef7-c7a4b4344058"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:26.800257 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-0d2a9930-6c4d-4c17-a014-3295fd5713b3 req-e057998a-bcb7-408d-9596-12e24a4e03a3 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.801518 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-0d2a9930-6c4d-4c17-a014-3295fd5713b3 req-e057998a-bcb7-408d-9596-12e24a4e03a3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.802609 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-0d2a9930-6c4d-4c17-a014-3295fd5713b3 req-e057998a-bcb7-408d-9596-12e24a4e03a3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.825873 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-0d2a9930-6c4d-4c17-a014-3295fd5713b3 req-e057998a-bcb7-408d-9596-12e24a4e03a3 service nova] Creating event network-vif-plugged:4e38f9d6-0235-42f8-8ef7-c7a4b4344058 for instance 7a6eed76-f803-4a8e-8890-5d899eca8800 on hv-cinder-maste Oct 30 01:13:26.836952 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-0d2a9930-6c4d-4c17-a014-3295fd5713b3 req-e057998a-bcb7-408d-9596-12e24a4e03a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068989 Oct 30 01:13:26.840388 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 212/427] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:27.208092 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-303e7616-51ed-490f-981c-b8fcdd458649 req-cabe9806-38b5-4152-b38e-3549b84c9551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f2accb-ba39-4187-bfb8-192a213ff63f", "tag": "f108db99-3311-466f-b641-553588f1878e"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:27.220898 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-303e7616-51ed-490f-981c-b8fcdd458649 req-cabe9806-38b5-4152-b38e-3549b84c9551 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:27.221874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-303e7616-51ed-490f-981c-b8fcdd458649 req-cabe9806-38b5-4152-b38e-3549b84c9551 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:27.222509 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-303e7616-51ed-490f-981c-b8fcdd458649 req-cabe9806-38b5-4152-b38e-3549b84c9551 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:27.224041 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:27.226406 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:27.238893 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-303e7616-51ed-490f-981c-b8fcdd458649 req-cabe9806-38b5-4152-b38e-3549b84c9551 service nova] Creating event network-changed:f108db99-3311-466f-b641-553588f1878e for instance f1f2accb-ba39-4187-bfb8-192a213ff63f on hv-cinder-maste Oct 30 01:13:27.245100 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:27.247488 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:27.247488 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:27.247747 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-303e7616-51ed-490f-981c-b8fcdd458649 req-cabe9806-38b5-4152-b38e-3549b84c9551 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044129 Oct 30 01:13:27.247833 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:27.247916 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 216/428] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:27.255528 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:27.256058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:27.293189 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ea2574ab-38f6-4ad3-ba92-7ebd5f53310e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077444 Oct 30 01:13:27.294173 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 213/429] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:13:27 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:27.323312 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:27.324292 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:27.336047 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:27.337349 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:27.338535 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:27.340884 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:27.342088 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:27.343768 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:27.622333 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:27.630917 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-84af5e5f-aaec-4d9c-a033-7775a9a48dab tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.313195 Oct 30 01:13:27.631439 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 217/430] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:27 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:27.664817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:27.664817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:27.670441 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:27.671197 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:27.671858 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:27.672872 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:27.673425 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:27.673972 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:27.839397 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:27.855485 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7509260f-e313-4009-96c4-98c790b8df67 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.196532 Oct 30 01:13:27.856625 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 214/431] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:27 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:27.941763 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-53715aac-f056-48c6-99fa-d00e08cf8c2e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'create', calling method: .version_select at 0x7f048c04ea60>, body: {"keypair": {"name": "tempest-keypair-809857420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PontCJRgsy9r6amRfN10+F+kxdMDHn6XAWxoEbKiLPTlTFHsWbj6LE0MIjxKH4xgxWVAv3C5Exp7I4oHjlXnL7G6rOdewuYhHcvQEmEsjeR4CMy1wLt3oVRR856/lvw=="}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:27.960995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-53715aac-f056-48c6-99fa-d00e08cf8c2e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:13:27.966327 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-53715aac-f056-48c6-99fa-d00e08cf8c2e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for user 2cfba439a18a4c8e8fa0021380128447 and project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:13:28.067966 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-53715aac-f056-48c6-99fa-d00e08cf8c2e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130584 Oct 30 01:13:28.068580 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 218/432] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:13:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:28.310125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.313268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:28.321280 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.321862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.322486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.323366 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.323945 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.324453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.381403 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d0c9a3c7-16c3-43bb-8e6a-f4786e62f602 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075283 Oct 30 01:13:28.382507 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 215/433] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:28.521971 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.522802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:28.530764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.531438 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.532232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.533105 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.533696 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.534329 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.567357 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:13:28.673644 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.674692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:28.683759 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.684962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.685964 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.688137 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.689278 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.690246 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.884452 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:28.896676 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4cdfce92-1afe-40e6-931f-87bcc24c7a01 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1359 microversion: 2.1 time: 0.230390 Oct 30 01:13:28.897523 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 216/434] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:28.904367 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.906061 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:28.914979 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.915805 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.916457 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.917792 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.918603 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.919344 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.982711 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ab215e9d-19af-4f0e-a60c-9885fb25a833 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "DELETE /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 204 len: 0 microversion: 2.1 time: 0.465594 Oct 30 01:13:28.984397 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 219/435] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:13:28 2022] DELETE /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:13:28.997088 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.998079 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:29.005611 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.006265 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.006786 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.007574 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.008205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.008861 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.170009 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:29.185325 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8eb32e76-d56e-4f8c-a5bf-a50183c66e7e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.286153 Oct 30 01:13:29.199723 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 217/436] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:29.277557 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:29.286533 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0eda10f0-4b75-4826-be2f-21ba33947ee4 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1687 microversion: 2.1 time: 0.296850 Oct 30 01:13:29.287132 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 220/437] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1687 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:29.921656 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:29.922370 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:29.929210 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.929703 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.930144 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.930858 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.931318 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.931786 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.083120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:30.095531 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-77ae41fd-de07-438f-b55a-49c0040401a5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1549 microversion: 2.1 time: 0.178459 Oct 30 01:13:30.096458 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 218/438] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:29 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1549 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:30.125727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.132991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:30.135552 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.136171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.136775 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.137790 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.138474 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.139137 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.213956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.215085 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:30.223660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.224349 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.224926 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.225772 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.226341 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.226959 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.336993 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:30.353969 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-dde6cd93-ea9d-46fb-a188-92b135124757 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1549 microversion: 2.1 time: 0.233017 Oct 30 01:13:30.370097 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 221/439] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1549 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:30.375451 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.377945 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:30.381666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:30.395063 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.396614 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.397687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.403797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.403797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.403797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.409088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:30.419073 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3e8b2eb7-2b4d-4fe6-b880-0076246e107e tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.213347 Oct 30 01:13:30.420135 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 219/440] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:30.426026 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.431880 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:30.433096 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Searching by: {'deleted': False, 'project_id': '77968fc2b85349b2a625ea9bf25cd026'} {{(pid=119523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:13:30.441132 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.441895 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.442578 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.444151 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.444884 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.445526 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.560213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.multi_cell_list [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:13:30.616426 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:30.628669 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-569df647-6e0e-4143-b3f5-c11a5353a9d5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1687 microversion: 2.1 time: 0.257093 Oct 30 01:13:30.634256 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 222/441] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1687 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:30.734385 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b576fcfd-a3c1-4e81-95e1-fda3e98d316c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.312224 Oct 30 01:13:30.747231 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 220/442] 10.222.0.26 () {58 vars in 1125 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:30.753970 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.754724 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:30.761211 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.761705 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.762139 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.762851 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.763308 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.763781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.933520 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:30.947493 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-db0d9eb5-c17e-4540-a6ed-093883d2b56f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1549 microversion: 2.1 time: 0.197699 Oct 30 01:13:30.959622 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 223/443] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1549 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:31.217178 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1600711597", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22a05b54-ab8c-4e6c-b771-2b6e93826000"}], "security_groups": [{"name": "tempest-securitygroup--247878202"}], "key_name": "tempest-keypair-809857420", "user_data": "}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:31.339759 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] validate_networks() for [('22a05b54-ab8c-4e6c-b771-2b6e93826000', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:13:31.458663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.459536 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:31.469046 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.469688 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.470334 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.471459 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.472522 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.473203 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.739029 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:31.748511 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6339b3e4-a59c-46b2-a235-bb3785df85b9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.294816 Oct 30 01:13:31.749858 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 224/444] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:31 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:31.769934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.769934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:31.774778 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.775644 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.775644 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.776068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.776643 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.777147 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.972746 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:13:31.972746 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:13:31.973555 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:13:31.974129 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:13:31.974404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:13:31.985517 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.986082 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.996866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.996866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.996866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.996866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.997982 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:32.003078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:32.006344 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-62327c0c-cd2c-4c28-8c2d-711bb8e96f57 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1687 microversion: 2.1 time: 0.254853 Oct 30 01:13:32.007147 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 225/445] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:31 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1687 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:32.010649 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:13:32.015612 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Getting quotas for user 2cfba439a18a4c8e8fa0021380128447 and project 82fc550e1caf445d8027e8051e0b4d30. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:13:32.028353 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:13:32.031301 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:13:32.184191 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ea4e3db4-e4f3-4717-80a5-79ce954140a3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.970902 Oct 30 01:13:32.185629 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 221/446] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:13:32.197545 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-85146038-40d8-4f40-9fe9-347daa0c75b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:32.198190 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-85146038-40d8-4f40-9fe9-347daa0c75b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:32.323207 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-85146038-40d8-4f40-9fe9-347daa0c75b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:32.345241 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-85146038-40d8-4f40-9fe9-347daa0c75b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1237 microversion: 2.1 time: 0.150058 Oct 30 01:13:32.346672 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 226/447] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:32 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1237 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:32.783105 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:32.784442 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:32.792677 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:32.793251 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:32.793801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:32.794898 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:32.795720 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:32.796605 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.035349 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:33.036305 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:33.045301 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.046348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.046790 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.053118 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.053118 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.053118 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.413436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:33.424674 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ec9d71e2-50f5-48e7-92bd-291b6619f1ee tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.646731 Oct 30 01:13:33.425267 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 222/448] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:32 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:33.430738 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fa4eb15-956b-4e8c-946c-4348ff904052"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:33.433407 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:33.440472 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.440968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.441402 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.443768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.443768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.443768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.510465 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:33.525950 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-891886d2-dfd4-4a2a-ade5-de6a9e5ce0a9 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1687 microversion: 2.1 time: 0.494035 Oct 30 01:13:33.526985 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 227/449] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:33 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1687 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:33.539420 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:33.541050 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:33.553808 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.554859 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.555691 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.560346 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.561236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.562205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.572150 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:33.655677 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:33.664152 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4d307a76-88a7-4af1-a6df-364cc7304ef3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1241 microversion: 2.1 time: 0.135243 Oct 30 01:13:33.665049 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 228/450] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:33 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:33.765079 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:34.296275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-a08a4921-c169-4977-85f0-64b1c81a402d req-a25b9d90-8418-4799-bbe8-b04dbd2368e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d6250d-ab71-49d8-843e-633f61eb9458", "name": "network-vif-deleted", "tag": "a670959f-9524-4528-b199-1b19260d3767"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:34.314964 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a08a4921-c169-4977-85f0-64b1c81a402d req-a25b9d90-8418-4799-bbe8-b04dbd2368e8 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:34.315803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a08a4921-c169-4977-85f0-64b1c81a402d req-a25b9d90-8418-4799-bbe8-b04dbd2368e8 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:34.316765 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a08a4921-c169-4977-85f0-64b1c81a402d req-a25b9d90-8418-4799-bbe8-b04dbd2368e8 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:34.339053 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-a08a4921-c169-4977-85f0-64b1c81a402d req-a25b9d90-8418-4799-bbe8-b04dbd2368e8 service nova] Creating event network-vif-deleted:a670959f-9524-4528-b199-1b19260d3767 for instance 56d6250d-ab71-49d8-843e-633f61eb9458 on hv-cinder-maste Oct 30 01:13:34.348496 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-a08a4921-c169-4977-85f0-64b1c81a402d req-a25b9d90-8418-4799-bbe8-b04dbd2368e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062700 Oct 30 01:13:34.349417 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 229/451] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 30 01:13:34.469969 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:34.472153 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:34.489590 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:34.490366 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:34.491125 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:34.492888 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:34.507273 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:34.509353 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:34.600034 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c256ce75-879c-4880-a554-ea6c9f2758cc tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.173182 Oct 30 01:13:34.606596 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 223/452] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:13:33 2022] POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:34.620854 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:34.622024 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:34.648787 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:34.649411 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:34.649927 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:34.651763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:34.656233 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:34.656788 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:34.811008 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:34.832793 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d690c271-60b0-4abf-8d19-09d445f9a755 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1328 microversion: 2.1 time: 0.230006 Oct 30 01:13:34.834047 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 224/453] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:34 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1328 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:34.842066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:34.856220 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c33620e0-1ac5-4174-8ce6-db0d84506e7b tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.397344 Oct 30 01:13:34.857013 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 230/454] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:34 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:34.864476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:34.865582 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:34.877185 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:34.880467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:34.880467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:34.880467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:34.880963 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:34.881731 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.020774 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:35.041039 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4eeb0980-7e15-41ea-8511-9a6993556487 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1289 microversion: 2.1 time: 0.204455 Oct 30 01:13:35.042398 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 225/455] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:34 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1289 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:35.868982 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:35.871375 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:35.888466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:35.889854 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:35.892608 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:35.893801 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:35.894562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.895903 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:35.896721 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:35.897690 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.898577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:35.899280 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:35.899966 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.900907 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:35.901551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:35.902155 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.962186 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:35.963382 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:35.964085 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.965439 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'fault' on Instance uuid 56d6250d-ab71-49d8-843e-633f61eb9458 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:36.032674 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:36.043337 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5b6829bc-34a5-4e13-9423-1b0356967b3e tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 200 len: 1333 microversion: 2.1 time: 0.186859 Oct 30 01:13:36.044336 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 231/456] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:35 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 1333 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:36.081627 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:36.082387 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:36.089114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:36.089711 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:36.090307 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:36.091253 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:36.091815 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:36.092346 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:36.159335 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:36.171811 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c55b3f00-b06c-476c-a0c7-05bb8bd05243 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.292016 Oct 30 01:13:36.176547 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 226/457] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:35 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:36.180687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:36.190843 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4c58cdff-bd83-48bd-99a0-19b3a4578ecf tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1295 microversion: 2.1 time: 0.113329 Oct 30 01:13:36.191722 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 232/458] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:36 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1295 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:36.793542 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-9a5ff2a1-7943-4e72-913d-968dddc36f25 req-38c32b61-80b3-446c-971d-d8d176804bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f2accb-ba39-4187-bfb8-192a213ff63f", "name": "network-vif-plugged", "status": "completed", "tag": "f108db99-3311-466f-b641-553588f1878e"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:36.812864 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-9a5ff2a1-7943-4e72-913d-968dddc36f25 req-38c32b61-80b3-446c-971d-d8d176804bc8 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:36.813644 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-9a5ff2a1-7943-4e72-913d-968dddc36f25 req-38c32b61-80b3-446c-971d-d8d176804bc8 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:36.814175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-9a5ff2a1-7943-4e72-913d-968dddc36f25 req-38c32b61-80b3-446c-971d-d8d176804bc8 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:36.828795 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-9a5ff2a1-7943-4e72-913d-968dddc36f25 req-38c32b61-80b3-446c-971d-d8d176804bc8 service nova] Creating event network-vif-plugged:f108db99-3311-466f-b641-553588f1878e for instance f1f2accb-ba39-4187-bfb8-192a213ff63f on hv-cinder-maste Oct 30 01:13:36.834051 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-9a5ff2a1-7943-4e72-913d-968dddc36f25 req-38c32b61-80b3-446c-971d-d8d176804bc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048537 Oct 30 01:13:36.834693 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 227/459] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:37.076574 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:37.079129 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 56d6250d-ab71-49d8-843e-633f61eb9458] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:37.088566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:37.089379 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:37.090047 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:37.091230 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:37.091926 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:37.092644 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:37.111613 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] HTTP exception thrown: Instance 56d6250d-ab71-49d8-843e-633f61eb9458 could not be found. Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Request method failure captured: Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 HTTP/1.1 Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc69huK0SDLXJgmIyu6BPqSYLCVEyIe9cHnN98C6O0bg_C7P_g7RJWF5daFRmnsRL19ij5JAK_vjEApIvbFGQlCjV-KCkLe9-zN-5krIMF7R5TTcyZppp7pWvZDYocAh55uvA4MKS4HDcGpFMmPnKZahm2375jZeXhgkqsq8CtjGUsI Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:13:37.113303 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: a4a4230574c846a9b4f7edd240317ee9 Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 56d6250d-ab71-49d8-843e-633f61eb9458 could not be found. Oct 30 01:13:37.116267 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '56d6250d-ab71-49d8-843e-633f61eb9458'} Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d6250d-ab71-49d8-843e-633f61eb9458 could not be found. Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:37.117362 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d6250d-ab71-49d8-843e-633f61eb9458 could not be found. Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d6250d-ab71-49d8-843e-633f61eb9458 could not be found. Oct 30 01:13:37.118524 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:37.119637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Returning 404 to user: Instance 56d6250d-ab71-49d8-843e-633f61eb9458 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:37.119637 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d771c8d3-9eec-47d1-a3d9-1f53f74d7a98 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458" status: 404 len: 111 microversion: 2.1 time: 0.044245 Oct 30 01:13:37.119637 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 233/460] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:37 2022] GET /compute/v2.1/servers/56d6250d-ab71-49d8-843e-633f61eb9458 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:13:37.132872 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8c05e58c-5820-4794-b141-e3c8ecda67bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '.version_select at 0x7f0487d67310>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:37.205155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:37.205653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:37.212514 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:37.213274 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:37.213724 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:37.214528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:37.215034 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:37.215464 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:37.280804 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8c05e58c-5820-4794-b141-e3c8ecda67bf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17187436" status: 202 len: 0 microversion: 2.1 time: 0.157532 Oct 30 01:13:37.282172 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 228/461] 10.222.0.26 () {58 vars in 1215 bytes} [Sun Oct 30 01:13:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17187436 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:37.291232 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:37.292538 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:37.325184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:37.325891 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:37.326676 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:37.328193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:37.328807 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:37.329374 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:37.644934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:37.658547 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-68811076-75ea-47ca-bd0d-12667024de21 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.458313 Oct 30 01:13:37.664560 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 234/462] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:37 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:37.757469 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:37.769399 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f1434090-b6ce-4e65-9a42-5cde65ff6911 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.485142 Oct 30 01:13:37.770742 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 229/463] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:37 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:38.287939 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:38.288745 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:38.299876 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-057cbcdc-bf3a-4c2a-9086-9e2131c57485 req-2f7a15da-818f-4176-930a-8a4337d42a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430780a7-f9ba-41fb-9e2d-e575994b4c22", "tag": "44604177-fdbb-4922-88e9-3af1a4695ad5"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:38.310983 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:38.311477 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:38.314064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:38.314805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:38.315271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:38.315856 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:38.320415 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-057cbcdc-bf3a-4c2a-9086-9e2131c57485 req-2f7a15da-818f-4176-930a-8a4337d42a63 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:38.321352 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-057cbcdc-bf3a-4c2a-9086-9e2131c57485 req-2f7a15da-818f-4176-930a-8a4337d42a63 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:38.322386 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-057cbcdc-bf3a-4c2a-9086-9e2131c57485 req-2f7a15da-818f-4176-930a-8a4337d42a63 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:38.346746 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-057cbcdc-bf3a-4c2a-9086-9e2131c57485 req-2f7a15da-818f-4176-930a-8a4337d42a63 service nova] Creating event network-changed:44604177-fdbb-4922-88e9-3af1a4695ad5 for instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 on hv-cinder-maste Oct 30 01:13:38.353145 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-057cbcdc-bf3a-4c2a-9086-9e2131c57485 req-2f7a15da-818f-4176-930a-8a4337d42a63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059097 Oct 30 01:13:38.354556 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 230/464] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:38.543763 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:38.555898 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-52c40e21-5b6b-4825-8b19-c45b19aa22c7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1595 microversion: 2.1 time: 0.272607 Oct 30 01:13:38.557087 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 235/465] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:38 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1595 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:38.687337 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:38.687337 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:38.694222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:38.694562 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:38.695312 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:38.696053 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:38.696909 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:38.697490 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:38.796377 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:38.797243 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:38.805460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:38.806788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:38.807516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:38.808921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:38.809605 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:38.810177 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:38.941586 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:38.951369 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-96a2bbfa-90b8-4e4f-81f6-18be38d96508 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1318 microversion: 2.1 time: 0.269392 Oct 30 01:13:38.952260 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 231/466] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:38 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:38.994434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:39.009427 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-84e404a9-f705-4d71-a1c6-ec8adb1e4bbc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.218351 Oct 30 01:13:39.010484 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 236/467] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:38 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:39.979844 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:39.981058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:39.993459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:39.994166 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:39.994760 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:39.995770 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:39.996624 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:39.997166 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:40.035125 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:40.037159 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:40.045874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:40.046779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:40.047418 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:40.048338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:40.049466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:40.050188 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:40.272325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:40.290202 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-244ced1f-e0fa-42a8-82e4-c188609c9f3d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1507 microversion: 2.1 time: 0.317927 Oct 30 01:13:40.294317 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 232/468] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:39 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:40.326939 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:40.331404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6bf4033-b607-4afc-b10e-1370a50a9807", "device": "/dev/sdb"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:40.334832 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:40.341406 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:40.341870 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-bc57e578-bd3e-4b73-b929-38ec73875425 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.311349 Oct 30 01:13:40.342030 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:40.342866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:40.343462 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 237/469] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:40 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:40.343669 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:40.344059 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:40.344487 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.223451 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:41.224364 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:41.247180 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.248111 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.249967 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.250447 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.251289 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.252616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.292044 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:13:41.689908 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3f7d74ce-b862-40c2-a145-2330b6a9bf6f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 204 len: 0 microversion: 2.1 time: 0.479839 Oct 30 01:13:41.695115 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 238/470] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:13:41 2022] DELETE /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:13:41.696125 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:41.696836 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:41.703350 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.703961 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.704404 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.705122 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.705581 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.706021 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.866340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:41.875924 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-03eca151-ca88-41a5-873d-484273810cfe tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.184095 Oct 30 01:13:41.876520 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 239/471] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:41 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:41.881536 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:41.882408 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:41.889978 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.890828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.891446 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.892420 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.893079 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.893859 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.970940 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8923c5fd-476b-436c-b50f-a24d768a0eff tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "POST /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.644576 Oct 30 01:13:41.972180 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 233/472] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:13:40 2022] POST /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f/os-volume_attachments => generated 194 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:41.983420 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-64d2a49d-4994-465d-ac0b-afed59d2f649 req-e9425751-82b8-47d7-bec7-f54f73c2bd4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6eed76-f803-4a8e-8890-5d899eca8800", "tag": "4e38f9d6-0235-42f8-8ef7-c7a4b4344058"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:41.999513 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=4 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:42.012120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-64d2a49d-4994-465d-ac0b-afed59d2f649 req-e9425751-82b8-47d7-bec7-f54f73c2bd4e service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:42.013031 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-64d2a49d-4994-465d-ac0b-afed59d2f649 req-e9425751-82b8-47d7-bec7-f54f73c2bd4e service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:42.013935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-64d2a49d-4994-465d-ac0b-afed59d2f649 req-e9425751-82b8-47d7-bec7-f54f73c2bd4e service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:42.033474 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:42.039640 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-64d2a49d-4994-465d-ac0b-afed59d2f649 req-e9425751-82b8-47d7-bec7-f54f73c2bd4e service nova] Creating event network-changed:4e38f9d6-0235-42f8-8ef7-c7a4b4344058 for instance 7a6eed76-f803-4a8e-8890-5d899eca8800 on hv-cinder-maste Oct 30 01:13:42.049755 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-64d2a49d-4994-465d-ac0b-afed59d2f649 req-e9425751-82b8-47d7-bec7-f54f73c2bd4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074930 Oct 30 01:13:42.059325 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 234/473] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:42.341238 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=6 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:42.392025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:42.407439 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ca4da1c4-5506-4063-a0a0-1ee2c451f06c tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1506 microversion: 2.1 time: 0.529042 Oct 30 01:13:42.408741 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 240/474] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:41 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:42.904112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:42.905822 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:42.915153 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:42.915936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:42.917667 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:42.917897 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:42.918478 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:42.919037 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.141675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:43.158094 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3bf78824-a8bd-42e0-9ce2-c812d61db1a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.259907 Oct 30 01:13:43.159713 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 235/475] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:42 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:43.455415 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:43.456853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:43.473231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:43.474738 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:43.475879 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.477311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:43.478296 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:43.479207 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.641702 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:43.650652 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e830a235-397e-4336-9d5e-57b5890a26e2 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1506 microversion: 2.1 time: 0.204963 Oct 30 01:13:43.651345 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 241/476] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:43 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:44.203528 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:44.208713 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:44.217920 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.218888 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.219881 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.221179 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.222161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.222761 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.614665 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:44.639978 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d07c923b-a87c-4224-b37a-bf30c66c0135 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.442402 Oct 30 01:13:44.640888 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 236/477] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:44 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:44.681861 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:44.687057 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:44.698223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.699827 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.700871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.702640 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.703840 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.705523 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.906896 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-26a475b0-71cc-44f9-a614-a8534da7ce60 req-fe52c36e-cdad-4906-91cb-15961664ee04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430780a7-f9ba-41fb-9e2d-e575994b4c22", "name": "network-vif-plugged", "status": "completed", "tag": "44604177-fdbb-4922-88e9-3af1a4695ad5"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:44.923680 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-26a475b0-71cc-44f9-a614-a8534da7ce60 req-fe52c36e-cdad-4906-91cb-15961664ee04 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.924462 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-26a475b0-71cc-44f9-a614-a8534da7ce60 req-fe52c36e-cdad-4906-91cb-15961664ee04 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.925139 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-26a475b0-71cc-44f9-a614-a8534da7ce60 req-fe52c36e-cdad-4906-91cb-15961664ee04 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.939428 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-26a475b0-71cc-44f9-a614-a8534da7ce60 req-fe52c36e-cdad-4906-91cb-15961664ee04 service nova] Creating event network-vif-plugged:44604177-fdbb-4922-88e9-3af1a4695ad5 for instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 on hv-cinder-maste Oct 30 01:13:44.945148 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-26a475b0-71cc-44f9-a614-a8534da7ce60 req-fe52c36e-cdad-4906-91cb-15961664ee04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056351 Oct 30 01:13:44.945786 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 237/478] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:45.036303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:45.047821 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-94f35aaa-ea94-4f6d-9853-dec3cd9baaea tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1506 microversion: 2.1 time: 0.371440 Oct 30 01:13:45.048806 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 242/479] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:44 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:45.346483 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-07b6dbd4-3e21-4d27-8db8-19876f5b101f req-1e4817e8-808e-4fbd-8564-70938ad42473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce81348d-b898-4087-8f2e-0b820ce0d9ce", "name": "network-vif-deleted", "tag": "fde77b6d-0e95-4d06-964a-83f5fdd6e5e9"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:45.387203 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-07b6dbd4-3e21-4d27-8db8-19876f5b101f req-1e4817e8-808e-4fbd-8564-70938ad42473 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.388423 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-07b6dbd4-3e21-4d27-8db8-19876f5b101f req-1e4817e8-808e-4fbd-8564-70938ad42473 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.395132 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-07b6dbd4-3e21-4d27-8db8-19876f5b101f req-1e4817e8-808e-4fbd-8564-70938ad42473 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.430296 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-07b6dbd4-3e21-4d27-8db8-19876f5b101f req-1e4817e8-808e-4fbd-8564-70938ad42473 service nova] Creating event network-vif-deleted:fde77b6d-0e95-4d06-964a-83f5fdd6e5e9 for instance ce81348d-b898-4087-8f2e-0b820ce0d9ce on hv-cinder-maste Oct 30 01:13:45.437741 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-07b6dbd4-3e21-4d27-8db8-19876f5b101f req-1e4817e8-808e-4fbd-8564-70938ad42473 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096327 Oct 30 01:13:45.441044 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 238/480] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:45.683959 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:45.685061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:45.711916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.712825 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.713507 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.714420 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.715000 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.715737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.909200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:45.917527 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d9926b4a-6ad4-4f63-8f9d-881528c92eea tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.240889 Oct 30 01:13:45.918132 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 243/481] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:45 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:45.945983 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-962231925"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:45.946814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:45.954024 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.954812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.955255 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.956236 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.956884 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.957296 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:46.083126 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:46.084247 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:46.095819 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.096734 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.097547 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:46.098974 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.100122 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.100891 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:46.110108 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:46.244232 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.network.security_group_api [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Adding security group 9d8cb7d8-fa55-49f4-a812-aebd81ac7376 to port 4e38f9d6-0235-42f8-8ef7-c7a4b4344058 Oct 30 01:13:46.252201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:46.265192 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-200f4e5b-2fd5-42c1-b52c-ee53ea0c1f69 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1291 microversion: 2.1 time: 0.189749 Oct 30 01:13:46.265979 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 244/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:46 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1291 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:46.818255 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-810e5405-6cf0-4783-9769-cb30636b5212 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/action" status: 202 len: 0 microversion: 2.1 time: 0.876108 Oct 30 01:13:46.819197 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 239/483] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:13:45 2022] POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/action => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:46.830434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:46.831509 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:46.840305 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.840963 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.841588 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:46.842475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.843205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.843810 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:46.947430 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:46.949136 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:46.961710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.962971 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.964089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:46.965626 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.966723 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.968454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:47.272258 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:47.291907 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-db0f0588-cbcb-4261-82a4-3ea411f3fc2e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1760 microversion: 2.1 time: 0.466356 Oct 30 01:13:47.294264 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 245/484] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:46 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1760 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:47.306453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:47.308740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:47.325647 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:47.327336 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:47.328559 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:47.331270 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:47.332217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:47.333220 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:47.343062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:47.358649 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4b81a59d-b030-4720-ac1e-83015053cba0 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1362 microversion: 2.1 time: 0.418144 Oct 30 01:13:47.360189 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 240/485] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:46 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:47.406597 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:47.407781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:47.409390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:47.409556 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'fault' on Instance uuid ce81348d-b898-4087-8f2e-0b820ce0d9ce {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:47.484707 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-70e271d6-f33b-4f5a-80bd-8be6a8d3b6cb req-2bae055b-7d73-4ca2-8dbb-283081d9eabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6eed76-f803-4a8e-8890-5d899eca8800", "tag": "4e38f9d6-0235-42f8-8ef7-c7a4b4344058"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:47.505005 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-70e271d6-f33b-4f5a-80bd-8be6a8d3b6cb req-2bae055b-7d73-4ca2-8dbb-283081d9eabb service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:47.505920 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-70e271d6-f33b-4f5a-80bd-8be6a8d3b6cb req-2bae055b-7d73-4ca2-8dbb-283081d9eabb service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:47.506735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-70e271d6-f33b-4f5a-80bd-8be6a8d3b6cb req-2bae055b-7d73-4ca2-8dbb-283081d9eabb service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:47.509756 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:47.523955 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ba2a0db1-1a0c-4bcb-9ef7-876fea68d5e1 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1310 microversion: 2.1 time: 0.226772 Oct 30 01:13:47.524827 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 246/486] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:47 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1310 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:47.528865 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-70e271d6-f33b-4f5a-80bd-8be6a8d3b6cb req-2bae055b-7d73-4ca2-8dbb-283081d9eabb service nova] Creating event network-changed:4e38f9d6-0235-42f8-8ef7-c7a4b4344058 for instance 7a6eed76-f803-4a8e-8890-5d899eca8800 on hv-cinder-maste Oct 30 01:13:47.538988 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-70e271d6-f33b-4f5a-80bd-8be6a8d3b6cb req-2bae055b-7d73-4ca2-8dbb-283081d9eabb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063266 Oct 30 01:13:47.540712 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 241/487] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:48.023560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f6bf4033-b607-4afc-b10e-1370a50a9807", "create_info": {"type": "qcow2", "new_file": "volume-f6bf4033-b607-4afc-b10e-1370a50a9807.8da256a6-e7a5-4d5d-bcaa-7b535d96d85f.vhdx", "snapshot_id": "8da256a6-e7a5-4d5d-bcaa-7b535d96d85f"}}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:48.028354 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.029146 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.030870 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.044551 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.045070 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.045556 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.060470 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-61d36928-1f69-4a0f-90fc-36dd37f23463 req-7cd2b5b4-bb4e-4a20-8ca1-91ec1ffab3cd admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.184623 Oct 30 01:13:48.061107 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 247/488] 10.222.0.61 () {64 vars in 1326 bytes} [Sun Oct 30 01:13:47 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:13:48.402656 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:48.403362 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:48.410593 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.411084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.411571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.412358 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.412810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.413233 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.550363 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:48.551224 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:48.559640 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.560238 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.561306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.562128 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.562784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.563384 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.600075 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.600476 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.600909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.601363 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'fault' on Instance uuid ce81348d-b898-4087-8f2e-0b820ce0d9ce {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:48.695635 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:48.702669 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:48.704444 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6ee78a92-0cb9-4f6b-89ad-befa738ee4e7 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 200 len: 1310 microversion: 2.1 time: 0.159426 Oct 30 01:13:48.705639 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 248/489] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:48 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:48.716054 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8c563c92-6e0e-45ea-b6de-67678c6889a8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1548 microversion: 2.1 time: 0.319574 Oct 30 01:13:48.716742 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 242/490] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:48 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1548 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:48.740977 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:48.741879 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:48.750959 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.751448 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.751920 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.752642 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.753097 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.753520 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.839831 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ec27d3c4-3e1a-455f-9885-c52851420af3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103080 Oct 30 01:13:48.840965 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 249/491] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:13:48 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:49.728815 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:49.729557 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: ce81348d-b898-4087-8f2e-0b820ce0d9ce] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:49.736964 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:49.737608 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:49.738192 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:49.738928 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:49.739459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:49.740647 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:49.756439 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] HTTP exception thrown: Instance ce81348d-b898-4087-8f2e-0b820ce0d9ce could not be found. Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Request method failure captured: Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce HTTP/1.1 Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc69huK0SDLXJgmIyu6BPqSYLCVEyIe9cHnN98C6O0bg_C7P_g7RJWF5daFRmnsRL19ij5JAK_vjEApIvbFGQlCjV-KCkLe9-zN-5krIMF7R5TTcyZppp7pWvZDYocAh55uvA4MKS4HDcGpFMmPnKZahm2375jZeXhgkqsq8CtjGUsI Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:13:49.758423 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: a4a4230574c846a9b4f7edd240317ee9 Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance ce81348d-b898-4087-8f2e-0b820ce0d9ce could not be found. Oct 30 01:13:49.765369 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'ce81348d-b898-4087-8f2e-0b820ce0d9ce'} Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce81348d-b898-4087-8f2e-0b820ce0d9ce could not be found. Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:49.766190 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce81348d-b898-4087-8f2e-0b820ce0d9ce could not be found. Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce81348d-b898-4087-8f2e-0b820ce0d9ce could not be found. Oct 30 01:13:49.767499 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:13:49.770589 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Returning 404 to user: Instance ce81348d-b898-4087-8f2e-0b820ce0d9ce could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:49.770589 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-dc7dbf51-66ab-45b1-aec8-ec6e2c9cbcc5 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce" status: 404 len: 111 microversion: 2.1 time: 0.035606 Oct 30 01:13:49.770589 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 243/492] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:49 2022] GET /compute/v2.1/servers/ce81348d-b898-4087-8f2e-0b820ce0d9ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:49.771095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:49.771095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:49.777921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:49.778409 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:49.778844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:49.780180 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:49.780639 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:49.781059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:49.810916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:13:50.267214 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3d69e3e4-1d90-4898-bb0b-d2e5efa36c6b tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 204 len: 0 microversion: 2.1 time: 0.500685 Oct 30 01:13:50.268237 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 250/493] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:13:49 2022] DELETE /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:13:50.277419 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:50.286503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:50.286503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.286503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.286503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.287234 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.287391 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.287960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.292654 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:50.612370 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:50.621010 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1ce498e0-6e0a-4d3c-90cb-858c40cd9852 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.348173 Oct 30 01:13:50.621596 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 244/494] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:50 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:50.846797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-f142a42f-6433-43a8-8e6a-836b11ca5bd3 req-bc0b82e0-e778-4ce0-9442-bfabc4e71e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430780a7-f9ba-41fb-9e2d-e575994b4c22", "tag": "44604177-fdbb-4922-88e9-3af1a4695ad5"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:50.858421 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-f142a42f-6433-43a8-8e6a-836b11ca5bd3 req-bc0b82e0-e778-4ce0-9442-bfabc4e71e03 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.858912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-f142a42f-6433-43a8-8e6a-836b11ca5bd3 req-bc0b82e0-e778-4ce0-9442-bfabc4e71e03 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.859348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-f142a42f-6433-43a8-8e6a-836b11ca5bd3 req-bc0b82e0-e778-4ce0-9442-bfabc4e71e03 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.872896 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-f142a42f-6433-43a8-8e6a-836b11ca5bd3 req-bc0b82e0-e778-4ce0-9442-bfabc4e71e03 service nova] Creating event network-changed:44604177-fdbb-4922-88e9-3af1a4695ad5 for instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 on hv-cinder-maste Oct 30 01:13:50.878532 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-f142a42f-6433-43a8-8e6a-836b11ca5bd3 req-bc0b82e0-e778-4ce0-9442-bfabc4e71e03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036436 Oct 30 01:13:50.879155 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 251/495] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:51.646544 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:51.648546 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:51.662964 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:51.663460 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:51.664052 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:51.664816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:51.665281 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:51.665712 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:51.845109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:51.855721 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7c5ba47a-85e8-4133-93fe-f6fc183d7977 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.214100 Oct 30 01:13:51.856745 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 245/496] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:51 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:52.895751 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:52.896548 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:52.903279 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:52.903812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:52.904774 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:52.905530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:52.905982 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:52.906401 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:53.068370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:53.077145 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2394313e-cbc6-4cc2-b2ab-60c3a4176304 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.186315 Oct 30 01:13:53.077817 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 252/497] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:52 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:53.367217 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f6bf4033-b607-4afc-b10e-1370a50a9807", "create_info": {"type": "qcow2", "new_file": "volume-f6bf4033-b607-4afc-b10e-1370a50a9807.5fc2513a-4ca1-4357-80a0-d9558f113ff0.vhdx", "snapshot_id": "5fc2513a-4ca1-4357-80a0-d9558f113ff0"}}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:53.370819 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:53.371364 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:53.371889 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:53.381514 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:53.382003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:53.382436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:53.398885 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-ae9d0eda-961c-4eee-9727-fbf3f27d67fa req-917a086a-80a5-4653-add3-10f6cb681495 admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.103239 Oct 30 01:13:53.399629 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 246/498] 10.222.0.61 () {64 vars in 1326 bytes} [Sun Oct 30 01:13:53 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:54.102322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:54.103025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:54.111052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:54.111548 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:54.112032 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:54.112750 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:54.113206 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:54.113634 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:54.277224 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:54.282270 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fd185fcd-37f3-4b60-b760-07f665a5e28f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1522 microversion: 2.1 time: 0.184334 Oct 30 01:13:54.282870 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 253/499] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:54 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:55.330718 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:55.333530 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:55.349867 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:55.350741 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:55.351551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:55.352829 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:55.353830 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:55.354664 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:55.429003 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-514a1c69-2cab-4f3c-8822-a06b1ca75d7b req-df15e072-b514-4ddc-b088-edc6997fb499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89eececf-ad51-4cbd-832b-a2f9d5a6dca8", "name": "network-vif-deleted", "tag": "a185d7cd-a5ab-4e8d-a4c4-2d137415dd18"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:55.455530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-514a1c69-2cab-4f3c-8822-a06b1ca75d7b req-df15e072-b514-4ddc-b088-edc6997fb499 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:55.455530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-514a1c69-2cab-4f3c-8822-a06b1ca75d7b req-df15e072-b514-4ddc-b088-edc6997fb499 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:55.455530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-514a1c69-2cab-4f3c-8822-a06b1ca75d7b req-df15e072-b514-4ddc-b088-edc6997fb499 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:55.474585 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:55.476686 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-514a1c69-2cab-4f3c-8822-a06b1ca75d7b req-df15e072-b514-4ddc-b088-edc6997fb499 service nova] Creating event network-vif-deleted:a185d7cd-a5ab-4e8d-a4c4-2d137415dd18 for instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 on hv-cinder-maste Oct 30 01:13:55.486538 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-514a1c69-2cab-4f3c-8822-a06b1ca75d7b req-df15e072-b514-4ddc-b088-edc6997fb499 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065713 Oct 30 01:13:55.491791 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c565c0bf-ea0e-4837-b223-c52c3bc33fbf tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1480 microversion: 2.1 time: 0.182243 Oct 30 01:13:55.491984 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 254/500] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:55.492600 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 247/501] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:55 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1480 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:56.530385 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:56.531566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:56.543013 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:56.543794 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:56.545087 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:56.546311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:56.547071 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:56.547818 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:56.608372 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:56.608906 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:56.609322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:56.609788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lazy-loading 'fault' on Instance uuid 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:13:56.657652 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4230574c846a9b4f7edd240317ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c63194a18f4768abe23f55608ec8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:56.668499 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-30ee186c-23f1-4254-afbd-ab7f1274519f tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 200 len: 1311 microversion: 2.1 time: 0.145329 Oct 30 01:13:56.669025 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 255/502] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:56 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:57.215717 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:57.219817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:57.220344 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:57.220806 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:57.230549 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:57.231039 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:57.231485 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:57.246570 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-ea7407f3-eaa3-4084-9695-b3e35635ad32 req-fcd5a6c4-48e4-47b7-be98-5b804f974b14 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/5fc2513a-4ca1-4357-80a0-d9558f113ff0?delete_info=%7B%22file_to_merge%22:%20%22volume-f6bf4033-b607-4afc-b10e-1370a50a9807.5fc2513a-4ca1-4357-80a0-d9558f113ff0.vhdx%22,%20%22volume_id%22:%20%22f6bf4033-b607-4afc-b10e-1370a50a9807%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.093931 Oct 30 01:13:57.247271 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 248/503] 10.222.0.61 () {62 vars in 1800 bytes} [Sun Oct 30 01:13:57 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/5fc2513a-4ca1-4357-80a0-d9558f113ff0?delete_info=%7B%22file_to_merge%22:%20%22volume-f6bf4033-b607-4afc-b10e-1370a50a9807.5fc2513a-4ca1-4357-80a0-d9558f113ff0.vhdx%22,%20%22volume_id%22:%20%22f6bf4033-b607-4afc-b10e-1370a50a9807%22%7D => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:13:57.698287 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:57.698941 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] [instance: 89eececf-ad51-4cbd-832b-a2f9d5a6dca8] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:57.706356 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:57.706849 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:57.707288 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:57.708050 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:57.708538 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:57.709003 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:57.724009 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] HTTP exception thrown: Instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 could not be found. Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Request method failure captured: Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 HTTP/1.1 Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc69huK0SDLXJgmIyu6BPqSYLCVEyIe9cHnN98C6O0bg_C7P_g7RJWF5daFRmnsRL19ij5JAK_vjEApIvbFGQlCjV-KCkLe9-zN-5krIMF7R5TTcyZppp7pWvZDYocAh55uvA4MKS4HDcGpFMmPnKZahm2375jZeXhgkqsq8CtjGUsI Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:13:57.725673 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95c63194a18f4768abe23f55608ec8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 95c63194a18f4768abe23f55608ec8c6 Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-831237817 Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: a4a4230574c846a9b4f7edd240317ee9 Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-ServerRescueNegativeTestJSON-831237817-project Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 could not be found. Oct 30 01:13:57.728077 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '89eececf-ad51-4cbd-832b-a2f9d5a6dca8'} Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 could not be found. Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:57.729719 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 could not be found. Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 could not be found. Oct 30 01:13:57.732840 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:13:57.735005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] Returning 404 to user: Instance 89eececf-ad51-4cbd-832b-a2f9d5a6dca8 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:57.735005 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3bc71944-ed14-43e5-a9dc-db22396d8953 tempest-ServerRescueNegativeTestJSON-831237817 tempest-ServerRescueNegativeTestJSON-831237817-project] 10.222.0.26 "GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8" status: 404 len: 111 microversion: 2.1 time: 0.033040 Oct 30 01:13:57.735005 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 256/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:57 2022] GET /compute/v2.1/servers/89eececf-ad51-4cbd-832b-a2f9d5a6dca8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:00.609742 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:00.613814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:00.614303 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:00.614731 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:00.630774 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:00.631274 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:00.631717 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:00.648475 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-ffeaf153-97ff-4b0b-83f6-1f59168613d1 req-f2e27690-7142-4f83-b572-a27da8c5db84 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/1c9c1469-f089-4587-91d4-b47bf5b66a87?delete_info=%7B%22file_to_merge%22:%20%22volume-f6bf4033-b607-4afc-b10e-1370a50a9807.1c9c1469-f089-4587-91d4-b47bf5b66a87.vhdx%22,%20%22volume_id%22:%20%22f6bf4033-b607-4afc-b10e-1370a50a9807%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.135927 Oct 30 01:14:00.649068 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 249/505] 10.222.0.61 () {62 vars in 1800 bytes} [Sun Oct 30 01:14:00 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/1c9c1469-f089-4587-91d4-b47bf5b66a87?delete_info=%7B%22file_to_merge%22:%20%22volume-f6bf4033-b607-4afc-b10e-1370a50a9807.1c9c1469-f089-4587-91d4-b47bf5b66a87.vhdx%22,%20%22volume_id%22:%20%22f6bf4033-b607-4afc-b10e-1370a50a9807%22%7D => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:14:03.881660 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:04.062078 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:04.067201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:04.067641 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:04.068388 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:04.079880 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:04.080524 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:04.081064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:04.098769 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-4ec397f4-42fa-4ccb-8587-d4b95967c5f1 req-00b018e4-8b88-40c1-b459-a069b49e62f3 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/8da256a6-e7a5-4d5d-bcaa-7b535d96d85f?delete_info=%7B%22file_to_merge%22:%20%22volume-f6bf4033-b607-4afc-b10e-1370a50a9807.8da256a6-e7a5-4d5d-bcaa-7b535d96d85f.vhdx%22,%20%22volume_id%22:%20%22f6bf4033-b607-4afc-b10e-1370a50a9807%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.221788 Oct 30 01:14:04.099496 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 257/506] 10.222.0.61 () {62 vars in 1800 bytes} [Sun Oct 30 01:14:03 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/8da256a6-e7a5-4d5d-bcaa-7b535d96d85f?delete_info=%7B%22file_to_merge%22:%20%22volume-f6bf4033-b607-4afc-b10e-1370a50a9807.8da256a6-e7a5-4d5d-bcaa-7b535d96d85f.vhdx%22,%20%22volume_id%22:%20%22f6bf4033-b607-4afc-b10e-1370a50a9807%22%7D => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:14:06.812799 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:06.817593 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:06.818199 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:06.824627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:06.825109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:06.826083 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:06.826801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:06.827251 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:06.827708 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:06.959734 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lazy-loading 'services' on Instance uuid f1f2accb-ba39-4187-bfb8-192a213ff63f {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:07.252524 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3d2edb26-a425-4a76-9748-a7cf3c7d7c09 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f/os-volume_attachments/f6bf4033-b607-4afc-b10e-1370a50a9807" status: 202 len: 0 microversion: 2.1 time: 0.440747 Oct 30 01:14:07.260537 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 250/507] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:14:06 2022] DELETE /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f/os-volume_attachments/f6bf4033-b607-4afc-b10e-1370a50a9807 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:14:08.499009 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:08.505917 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:08.506564 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:08.524105 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:08.524601 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:08.525032 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:08.525768 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:08.526271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:08.526702 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:08.595577 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:14:09.046004 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-57de8412-8de8-4feb-8bad-0a07695387e9 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 204 len: 0 microversion: 2.1 time: 0.546929 Oct 30 01:14:09.047176 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 258/508] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:08 2022] DELETE /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:14:09.068721 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:09.070384 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:09.083097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.084026 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.085206 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:09.086980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.087797 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.088538 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:09.524039 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:09.534361 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0d2053d9-732d-4cdb-8098-da07d625d181 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1513 microversion: 2.1 time: 0.479771 Oct 30 01:14:09.534962 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 251/509] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:09 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:09.969279 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:09.974433 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:09.986941 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.987884 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.988748 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:09.990069 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.991176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.991970 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.078628 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:10.271854 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e267d77d-a2a2-4e39-a28c-4211f03ef690 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/action" status: 202 len: 0 microversion: 2.1 time: 0.310765 Oct 30 01:14:10.272933 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 259/510] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:14:09 2022] POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:10.287356 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:10.288531 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:10.301095 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.301962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.302674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.303951 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.304766 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.305511 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.569570 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:10.571217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:10.585708 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.587517 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.588444 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.589956 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.591740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.592955 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.631054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:10.643014 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:10.654429 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c6f18b72-c6e0-4b3b-bd8d-85a733782c0d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1752 microversion: 2.1 time: 0.374393 Oct 30 01:14:10.655023 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 252/511] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:10 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1752 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:10.994629 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:11.006192 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ebdb71ca-8712-4d4f-a1c6-107aed0a0c4d tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1513 microversion: 2.1 time: 0.447113 Oct 30 01:14:11.006798 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 260/512] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:10 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:11.706838 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:11.708028 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:11.721808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:11.722710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:11.723387 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:11.724397 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:11.725160 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:11.725765 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:12.051204 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.053372 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:12.066151 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:12.067150 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:12.068036 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:12.069686 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:12.070809 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:12.071577 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:12.224866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:12.242473 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9300b141-c82d-4f3f-83bd-c330a55d5b30 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1752 microversion: 2.1 time: 0.543190 Oct 30 01:14:12.244426 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 253/513] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1752 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:12.487140 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:12.503512 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-62430617-f9d7-4c94-88ed-94f2e96cf18a tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1513 microversion: 2.1 time: 0.459724 Oct 30 01:14:12.531693 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 261/514] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:13.017421 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-848edc55-b445-4bd2-a047-f643d4e0779b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'create', calling method: .version_select at 0x7f0487dbb4c0>, body: {"keypair": {"name": "tempest-keypair-92011683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmCtbjNWo2gn+Xsw91Llz34R3AB7LWiD2x9PUtsBmCP5GRI8KvI9LljgM6e9pnkEWEoHr28ZjUQ460dI0s0/W4Udd5Cgq4HrzZsT6g6UAzx566hD1BDMLr/h6eAIl+bsg=="}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:13.034912 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-848edc55-b445-4bd2-a047-f643d4e0779b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for project 6e74d6179e574138841007195fd72400. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:13.039200 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-848edc55-b445-4bd2-a047-f643d4e0779b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for user 1d21128dee354a04bfb008efe6b60899 and project 6e74d6179e574138841007195fd72400. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:13.204718 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-848edc55-b445-4bd2-a047-f643d4e0779b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.249338 Oct 30 01:14:13.205348 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 254/515] 10.222.0.26 () {62 vars in 1200 bytes} [Sun Oct 30 01:14:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:14:13.280272 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:13.280834 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:13.288247 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.298731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.298731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.298731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.298731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.299414 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.502808 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:13.512071 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-aaab73d9-51aa-4589-8181-e0454b2a38e8 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1752 microversion: 2.1 time: 0.235738 Oct 30 01:14:13.512910 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 262/516] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:13 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1752 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:13.550248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:13.551272 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:13.564675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.565259 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.565739 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.566513 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.567012 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.567479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.760079 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:13.772004 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f47ea9ff-acd3-4577-aed2-f23c12adea48 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1513 microversion: 2.1 time: 0.225482 Oct 30 01:14:13.772836 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 255/517] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:13 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:14.551023 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.552132 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:14.582040 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:14.586447 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.588358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.589759 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.596419 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.596419 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.596419 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.809409 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.812760 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:14.825378 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.826500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.829209 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.829209 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.830346 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.831562 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.491829 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:15.502222 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:15.514679 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9b9663d2-7502-4cfa-af5c-275c3947024c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1752 microversion: 2.1 time: 0.973677 Oct 30 01:14:15.518421 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9efc50f7-e7fb-46c1-8050-b4a3023632f7 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1513 microversion: 2.1 time: 0.716914 Oct 30 01:14:15.519616 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 263/518] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:14 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1752 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:15.521863 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 256/519] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:14 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1513 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:16.490761 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-3d75299f-7d6c-4d57-b99a-b6a6fa0fa1f2 req-d4bd40b9-614e-4628-8b29-247f54cd1ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f2accb-ba39-4187-bfb8-192a213ff63f", "name": "network-vif-deleted", "tag": "f108db99-3311-466f-b641-553588f1878e"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:16.525696 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3d75299f-7d6c-4d57-b99a-b6a6fa0fa1f2 req-d4bd40b9-614e-4628-8b29-247f54cd1ce5 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.526665 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3d75299f-7d6c-4d57-b99a-b6a6fa0fa1f2 req-d4bd40b9-614e-4628-8b29-247f54cd1ce5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.530792 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3d75299f-7d6c-4d57-b99a-b6a6fa0fa1f2 req-d4bd40b9-614e-4628-8b29-247f54cd1ce5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.555307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:16.557595 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:16.559749 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-3d75299f-7d6c-4d57-b99a-b6a6fa0fa1f2 req-d4bd40b9-614e-4628-8b29-247f54cd1ce5 service nova] Creating event network-vif-deleted:f108db99-3311-466f-b641-553588f1878e for instance f1f2accb-ba39-4187-bfb8-192a213ff63f on hv-cinder-maste Oct 30 01:14:16.576541 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-3d75299f-7d6c-4d57-b99a-b6a6fa0fa1f2 req-d4bd40b9-614e-4628-8b29-247f54cd1ce5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088953 Oct 30 01:14:16.584787 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 264/520] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:16.594415 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.595765 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.597953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:16.599729 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.600150 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:16.602485 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.603731 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.604792 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.632666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.639150 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.640999 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.643562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.644437 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.645199 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.968362 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:17.005937 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4b8d4cfb-eaac-45a0-bfe0-1f2435f96a78 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1471 microversion: 2.1 time: 0.417105 Oct 30 01:14:17.008007 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 265/521] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:16 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:17.086172 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:17.103149 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ec7dd678-5345-4545-ba40-0601a1fec74e tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1752 microversion: 2.1 time: 0.561176 Oct 30 01:14:17.105107 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 257/522] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:16 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1752 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:17.276489 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-805569677", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6257f567-c00a-4953-abb1-a059fb358974"}], "security_groups": [{"name": "tempest-securitygroup--1134276450"}], "key_name": "tempest-keypair-92011683", "user_data": "}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:17.448025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] validate_networks() for [('6257f567-c00a-4953-abb1-a059fb358974', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:17.998788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:17.998788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:17.999506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:17.999506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:17.999889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:18.010517 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.011061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.011491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.012867 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.013358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.013779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.033661 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for project 6e74d6179e574138841007195fd72400. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:18.039927 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for user 1d21128dee354a04bfb008efe6b60899 and project 6e74d6179e574138841007195fd72400. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:18.046075 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:18.046891 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:18.056053 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:18.057258 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.058151 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.058989 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.060138 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:18.060960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.061758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.062510 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.102685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.103177 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.103641 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.104093 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lazy-loading 'fault' on Instance uuid f1f2accb-ba39-4187-bfb8-192a213ff63f {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:18.158442 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254fc77e32147fdb3a28422b8458039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e8d209ae34edca0d7dc5dae71129a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.172585 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-acc0a0ab-82a7-49ae-85c6-f33a50478697 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 200 len: 1308 microversion: 2.1 time: 0.130877 Oct 30 01:14:18.173637 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 258/523] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:18 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:18.182348 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:18.183467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:18.195182 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.196055 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.196849 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.198132 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.203869 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.203869 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.209688 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-25e207b4-f8fb-4957-aba7-386f52d43956 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.939627 Oct 30 01:14:18.210629 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 266/524] 10.222.0.26 () {62 vars in 1188 bytes} [Sun Oct 30 01:14:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:14:18.223160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b674f394-ada4-4280-9b65-82f425aaa65b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:18.224026 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b674f394-ada4-4280-9b65-82f425aaa65b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:18.389622 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b674f394-ada4-4280-9b65-82f425aaa65b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.408724 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b674f394-ada4-4280-9b65-82f425aaa65b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.412633 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b674f394-ada4-4280-9b65-82f425aaa65b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.415192 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b674f394-ada4-4280-9b65-82f425aaa65b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1279 microversion: 2.20 time: 0.196205 Oct 30 01:14:18.423699 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 267/525] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:18 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:18.500149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.573268 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-101a8efc-de63-4314-9abc-840e648fc986 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.334793 Oct 30 01:14:18.573268 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 259/526] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:18 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:19.205732 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:19.206832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] [instance: f1f2accb-ba39-4187-bfb8-192a213ff63f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:19.218887 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.219802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.220566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.221871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.222679 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.223441 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.248635 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] HTTP exception thrown: Instance f1f2accb-ba39-4187-bfb8-192a213ff63f could not be found. Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Request method failure captured: Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f HTTP/1.1 Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc83nQk29WHTzKZsVahVxLmJDIRWvW7-R9zuOsztGPuGygmAwvODsIoX7HUGTpAlLa5ExAyl8VN7ZfW6hcrQV9KWf54jXWdK4JHNrxnCLf7cOgGxNngHXzLoFgRAeFQ6dW0gkInug9X6iJIu0D7CHcum4yU-zntJo5s5RKWeoOaof6M Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: ec0e8d209ae34edca0d7dc5dae71129a Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1480960158 Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:14:19.251719 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec0e8d209ae34edca0d7dc5dae71129a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesSnapshotTestJSON-1480960158 Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: ec0e8d209ae34edca0d7dc5dae71129a Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1480960158 Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesSnapshotTestJSON-1480960158-project Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 9254fc77e32147fdb3a28422b8458039 Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesSnapshotTestJSON-1480960158-project Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance f1f2accb-ba39-4187-bfb8-192a213ff63f could not be found. Oct 30 01:14:19.254402 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'f1f2accb-ba39-4187-bfb8-192a213ff63f'} Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f2accb-ba39-4187-bfb8-192a213ff63f could not be found. Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:19.255665 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f2accb-ba39-4187-bfb8-192a213ff63f could not be found. Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f2accb-ba39-4187-bfb8-192a213ff63f could not be found. Oct 30 01:14:19.257846 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:19.259705 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] Returning 404 to user: Instance f1f2accb-ba39-4187-bfb8-192a213ff63f could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:19.259705 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ed8d4b62-5734-47df-a267-37811b2a3675 tempest-VolumesSnapshotTestJSON-1480960158 tempest-VolumesSnapshotTestJSON-1480960158-project] 10.222.0.26 "GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f" status: 404 len: 111 microversion: 2.1 time: 0.056040 Oct 30 01:14:19.259705 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 268/527] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:19 2022] GET /compute/v2.1/servers/f1f2accb-ba39-4187-bfb8-192a213ff63f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:19.444363 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9ec93a09-d27e-46a9-b6a5-aa839220ef8d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:19.445391 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9ec93a09-d27e-46a9-b6a5-aa839220ef8d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:19.522441 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9ec93a09-d27e-46a9-b6a5-aa839220ef8d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:19.531002 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9ec93a09-d27e-46a9-b6a5-aa839220ef8d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:19.532442 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9ec93a09-d27e-46a9-b6a5-aa839220ef8d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:19.533567 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9ec93a09-d27e-46a9-b6a5-aa839220ef8d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1279 microversion: 2.20 time: 0.094460 Oct 30 01:14:19.547636 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 260/528] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:19 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:19.601890 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:19.603226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:19.610238 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.620358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.620358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.620358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.620358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.620995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.803077 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:19.813313 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8674e8d3-23b8-43ca-85ba-c9fccfcab0d5 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.215652 Oct 30 01:14:19.813895 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 269/529] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:19 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:20.563857 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:20.564496 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:20.572652 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.573149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.573584 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.574325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.574879 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.575308 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.578966 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:20.662271 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:20.686349 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:20.689689 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:20.695132 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0c3389db-6ccd-4937-acb2-ca50ef24e003 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1275 microversion: 2.20 time: 0.132213 Oct 30 01:14:20.695132 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 261/530] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:20 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:20.853485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:20.854763 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:20.863158 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.871011 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.871011 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.871011 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.871011 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.872224 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.041855 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:21.054456 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d28c5783-eda0-4659-aafd-e85e35b7fd9c tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.204512 Oct 30 01:14:21.072036 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 270/531] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:20 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:21.728084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:21.728987 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:21.736955 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.737774 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.738303 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.739296 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.739927 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.740835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.872189 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:21.882064 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:21.883616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:21.884789 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-dbc63f3f-c40a-48fc-b57f-05e7290cd8bb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1339 microversion: 2.20 time: 0.164484 Oct 30 01:14:21.885346 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 262/532] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:21 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:22.090018 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:22.092391 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:22.104807 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.105730 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.106538 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.107892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.108719 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.109496 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.393550 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:22.407811 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-56aab1b3-ef06-4746-9706-8a264d2a7b34 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.324006 Oct 30 01:14:22.408888 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 271/533] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:22 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:22.919135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:22.920213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:22.933190 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.938791 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.938791 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.938791 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.938791 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.939363 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.213763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.224196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.226989 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.228564 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-57d153c9-c920-41a5-8052-2788f62146e7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.319237 Oct 30 01:14:23.229176 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 263/534] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:22 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:23.441621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:23.444187 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:23.458392 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.459113 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.459666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.462674 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.463476 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.464615 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.732187 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.732187 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0d39eb6a-5a17-4bda-b5b8-02b7591d483f tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.297606 Oct 30 01:14:23.732187 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 272/535] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:23 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:24.277581 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:24.279171 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:24.283520 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-a0634873-4ec8-43b6-b10c-6a7d68f2a796 req-93201cf0-5600-4eba-98c6-ebd8f7dfd2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61f5ece-c472-4444-b1e0-365185ebf03f", "tag": "1d6fd425-3461-45ae-8efb-bc1ff24c309a"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:24.297665 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a0634873-4ec8-43b6-b10c-6a7d68f2a796 req-93201cf0-5600-4eba-98c6-ebd8f7dfd2c6 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.302114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a0634873-4ec8-43b6-b10c-6a7d68f2a796 req-93201cf0-5600-4eba-98c6-ebd8f7dfd2c6 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.302114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a0634873-4ec8-43b6-b10c-6a7d68f2a796 req-93201cf0-5600-4eba-98c6-ebd8f7dfd2c6 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.302486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.302486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.302486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.302486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.303084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.303425 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.317858 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-a0634873-4ec8-43b6-b10c-6a7d68f2a796 req-93201cf0-5600-4eba-98c6-ebd8f7dfd2c6 service nova] Creating event network-changed:1d6fd425-3461-45ae-8efb-bc1ff24c309a for instance a61f5ece-c472-4444-b1e0-365185ebf03f on hv-cinder-maste Oct 30 01:14:24.327315 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-a0634873-4ec8-43b6-b10c-6a7d68f2a796 req-93201cf0-5600-4eba-98c6-ebd8f7dfd2c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055967 Oct 30 01:14:24.328308 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 273/536] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:24.636249 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.647575 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.649772 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.651111 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a5873c87-59af-44b0-af40-8cbef12dad22 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.378766 Oct 30 01:14:24.652183 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 264/537] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:24 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:24.756925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:24.758005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:24.767063 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.767683 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.768232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.769106 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.769751 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.770292 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.305889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:25.316713 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3c5180a8-e30b-4710-a115-7d5497f5efe2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.564550 Oct 30 01:14:25.317416 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 274/538] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:24 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:25.679499 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:25.680380 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:25.688476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.689153 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.689605 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.690360 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.690818 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.691451 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.879935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:25.889432 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:25.890998 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:25.892249 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1d232c98-e19b-40c3-b6d4-41100af9bb11 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.217815 Oct 30 01:14:25.892825 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 265/539] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:25 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:26.354499 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:26.355116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:26.362323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.362811 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.363252 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.364000 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.364444 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.365171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.542608 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:26.557838 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-286e00c2-ad00-43c4-839d-35b1cdcd6fce tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.206830 Oct 30 01:14:26.559378 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 275/540] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:26 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:26.931947 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:26.932662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:26.940277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.940755 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.941178 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.941873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.942391 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.942969 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.101782 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.117437 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.120283 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.123013 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9194c4ee-88bd-43e5-ad1a-d845540dc860 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.194726 Oct 30 01:14:27.131217 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 266/541] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:26 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:27.250624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:27.251225 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:27.258888 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.259475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.260016 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.260863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.261371 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.261886 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.289226 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0dd11467-fb25-48a2-9408-4fe1c086918b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/ips" status: 200 len: 146 microversion: 2.1 time: 0.211156 Oct 30 01:14:27.289779 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 276/542] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:14:27 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/ips => generated 146 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:27.596412 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:27.597024 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:27.603674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.604205 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.604642 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.605392 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.606501 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.606918 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.810860 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.820568 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1e39bcd3-9bff-4c74-8a2e-189e262f2256 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.228091 Oct 30 01:14:27.821322 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 267/543] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:27 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:28.167793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:28.169921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:28.174323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:28.184294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.185183 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.185862 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.188781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.188984 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.189673 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.360559 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:28.377325 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:28.380313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:28.382673 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-932ad17a-7ee0-45aa-bd61-0660f1573785 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.219911 Oct 30 01:14:28.383718 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 277/544] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:28 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:28.847254 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:28.852306 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:28.856143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.856722 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.857163 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.857902 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.859043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.859043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.055085 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.069572 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c6d5a8f8-fbf8-4009-99a8-4d55dab01391 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.226149 Oct 30 01:14:29.076195 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 268/545] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:28 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:29.158636 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b8960e6-210b-4e46-b3ca-727a67b17071"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:29.161055 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:29.163043 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=8 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:29.169790 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.170586 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.178637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.178637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.178637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.178637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.425911 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:29.426512 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:29.433216 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.433776 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.434210 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.434917 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.435371 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.435817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.526977 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:29.619112 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.634321 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.636168 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.638208 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e9e6e638-ef88-4c2c-8d80-7e596a566090 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.216503 Oct 30 01:14:29.638945 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 269/546] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:29 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:30.107120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:30.108264 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:30.124793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:30.127815 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.128314 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.128985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.129917 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.130526 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.131087 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.303498 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:30.319680 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6c0fafde-cb0c-449c-a6c3-4cda6273900b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.217073 Oct 30 01:14:30.320742 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 270/547] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:30 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:30.418922 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-00d05c84-8695-4b52-b3d6-7563695ffe3c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.263786 Oct 30 01:14:30.419895 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 278/548] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:14:29 2022] POST /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments => generated 194 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:30.668552 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:30.670217 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:30.684283 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.685114 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.686015 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.688312 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.689000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.689543 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.875325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:30.889306 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:30.891293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:30.892775 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-10bef6b7-170d-4b2d-ae17-3e15f0f8d295 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.232796 Oct 30 01:14:30.893996 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 271/549] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:30 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:31.031572 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-84f87feb-090b-41c8-8ef5-3228cf4348a5 req-9eab8d58-1a04-4fe5-b331-bee3b2df4b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61f5ece-c472-4444-b1e0-365185ebf03f", "name": "network-vif-plugged", "status": "completed", "tag": "1d6fd425-3461-45ae-8efb-bc1ff24c309a"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:31.049957 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-84f87feb-090b-41c8-8ef5-3228cf4348a5 req-9eab8d58-1a04-4fe5-b331-bee3b2df4b9d service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.050764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-84f87feb-090b-41c8-8ef5-3228cf4348a5 req-9eab8d58-1a04-4fe5-b331-bee3b2df4b9d service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.051607 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-84f87feb-090b-41c8-8ef5-3228cf4348a5 req-9eab8d58-1a04-4fe5-b331-bee3b2df4b9d service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.074894 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-84f87feb-090b-41c8-8ef5-3228cf4348a5 req-9eab8d58-1a04-4fe5-b331-bee3b2df4b9d service nova] Creating event network-vif-plugged:1d6fd425-3461-45ae-8efb-bc1ff24c309a for instance a61f5ece-c472-4444-b1e0-365185ebf03f on hv-cinder-maste Oct 30 01:14:31.084211 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-84f87feb-090b-41c8-8ef5-3228cf4348a5 req-9eab8d58-1a04-4fe5-b331-bee3b2df4b9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062154 Oct 30 01:14:31.085264 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 279/550] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:31.352427 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:31.353339 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:31.360733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.369159 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.369159 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.369159 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.369159 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.370106 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.556151 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:31.572827 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a717d58d-0285-41bc-b9d6-66da43b0142d tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.224133 Oct 30 01:14:31.573889 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 272/551] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:31 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:31.933577 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:31.934306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:31.941237 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.941720 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.942149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.942850 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.943296 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.943739 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.095955 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.104881 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.106328 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.107462 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9c68f60a-4eb8-498f-89bd-4a7fa1b68bd6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.178631 Oct 30 01:14:32.108070 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 280/552] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:31 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:32.602173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:32.604053 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:32.613242 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.614078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.614921 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.617180 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.617180 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.617463 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.808271 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.818763 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7998b6fb-cac7-42f9-ae0a-88a076f059be tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1757 microversion: 2.1 time: 0.222813 Oct 30 01:14:32.820000 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 273/553] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:32 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:33.134555 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.135562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:33.144355 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.145044 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.145549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.146516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.147070 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.147680 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.310954 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:33.319915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:33.321447 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:33.322612 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b713318f-0d6f-4f6d-ae71-71a65c3e93eb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1405 microversion: 2.20 time: 0.192762 Oct 30 01:14:33.323193 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 281/554] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:33 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:33.856723 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.857852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.858041 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:33.860165 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:33.867074 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.867566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.868058 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.868771 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.869291 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.869532 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.869718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.870139 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.870699 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.871761 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.872361 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.872926 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.906821 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-48fab078-261d-447d-8466-33fc9d58960f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053131 Oct 30 01:14:33.907621 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 282/555] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:14:33 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:33.918844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.919337 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:33.926026 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.926569 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.927015 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.927864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.928333 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.928793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.972398 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3c6a6aa8-87ff-471e-a907-035b670b15dc tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/3b8960e6-210b-4e46-b3ca-727a67b17071" status: 200 len: 194 microversion: 2.1 time: 0.057609 Oct 30 01:14:33.973175 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 283/556] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Oct 30 01:14:33 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/3b8960e6-210b-4e46-b3ca-727a67b17071 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:34.097680 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:34.113991 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e2a699d4-a6dd-47a1-ae54-2aec3b58d70a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1760 microversion: 2.1 time: 0.264884 Oct 30 01:14:34.114971 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 274/557] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:33 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1760 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:34.349326 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:34.350140 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:34.357234 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.357795 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.358372 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.359160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.359726 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.360207 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.559540 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:34.568648 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:34.570133 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:34.571414 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8e501e01-b522-426d-b757-014a3d9e3845 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1596 microversion: 2.20 time: 0.226143 Oct 30 01:14:34.572018 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 284/558] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:34 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1596 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:34.606781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:34.607307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:34.613990 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.614486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.615198 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.615951 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.616477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.616904 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.717527 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4b0105a8-5e7f-497d-94e8-2e64abb9b74d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109582 Oct 30 01:14:34.717527 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 275/559] 10.222.0.26 () {60 vars in 1316 bytes} [Sun Oct 30 01:14:34 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:14:35.861876 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29819b88-9146-464f-a66e-915c9f4e0f28"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:35.865289 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:35.874019 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:35.874678 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:35.875289 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:35.876231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:35.876912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:35.877596 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.289896 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-af7d273d-fad1-4154-a6e1-3b96ef8bcb34 req-764be5f2-ca61-4352-a879-9319191ce762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61f5ece-c472-4444-b1e0-365185ebf03f", "tag": "1d6fd425-3461-45ae-8efb-bc1ff24c309a"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:36.302497 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-af7d273d-fad1-4154-a6e1-3b96ef8bcb34 req-764be5f2-ca61-4352-a879-9319191ce762 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.302956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-af7d273d-fad1-4154-a6e1-3b96ef8bcb34 req-764be5f2-ca61-4352-a879-9319191ce762 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.303380 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-af7d273d-fad1-4154-a6e1-3b96ef8bcb34 req-764be5f2-ca61-4352-a879-9319191ce762 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.317677 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-af7d273d-fad1-4154-a6e1-3b96ef8bcb34 req-764be5f2-ca61-4352-a879-9319191ce762 service nova] Creating event network-changed:1d6fd425-3461-45ae-8efb-bc1ff24c309a for instance a61f5ece-c472-4444-b1e0-365185ebf03f on hv-cinder-maste Oct 30 01:14:36.323504 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-af7d273d-fad1-4154-a6e1-3b96ef8bcb34 req-764be5f2-ca61-4352-a879-9319191ce762 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038024 Oct 30 01:14:36.325079 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 276/560] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:37.007694 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fc45d4d2-a35a-4d39-a27d-3e716d09ddc8 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "POST /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.151328 Oct 30 01:14:37.019258 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 285/561] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:14:35 2022] POST /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments => generated 194 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:39.515488 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.518028 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:39.520397 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:39.526500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.527546 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.528023 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.528760 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.529420 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.529862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.567480 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f0ceedac-9955-4864-9c1b-e392fa9f9387 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057360 Oct 30 01:14:39.568287 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 277/562] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:14:39 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:39.712549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.713218 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:39.716346 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:39.722762 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.723255 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.723719 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.724475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.724959 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.725381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.762502 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8bf76575-b9fe-4310-9739-b4d01c29b606 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/3b8960e6-210b-4e46-b3ca-727a67b17071" status: 200 len: 194 microversion: 2.1 time: 0.055573 Oct 30 01:14:39.763132 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 286/563] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Oct 30 01:14:39 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/3b8960e6-210b-4e46-b3ca-727a67b17071 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:39.774815 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.775393 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:39.784039 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.787835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.787835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.787835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.787835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.788406 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.877572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:39.888698 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lazy-loading 'services' on Instance uuid 430780a7-f9ba-41fb-9e2d-e575994b4c22 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:40.190500 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7a845af8-24ae-47e8-ad08-636846cf255c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/3b8960e6-210b-4e46-b3ca-727a67b17071" status: 202 len: 0 microversion: 2.1 time: 0.419811 Oct 30 01:14:40.190977 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 278/564] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:14:39 2022] DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/3b8960e6-210b-4e46-b3ca-727a67b17071 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:42.434110 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:42.434750 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:42.446075 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.446807 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.447460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.448593 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.449306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.450059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.495293 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ee9c030b-34cb-4908-a23b-8781f217a8f3 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/29819b88-9146-464f-a66e-915c9f4e0f28" status: 200 len: 194 microversion: 2.1 time: 0.068274 Oct 30 01:14:42.496106 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 287/565] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Oct 30 01:14:42 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/29819b88-9146-464f-a66e-915c9f4e0f28 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:42.518604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:42.519697 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:42.531968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.532859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.533651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.535044 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.535825 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.536645 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.655763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lazy-loading 'services' on Instance uuid 430780a7-f9ba-41fb-9e2d-e575994b4c22 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:42.933243 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-29751b4e-71e5-4849-8fb0-7a8cbc1c2a5c tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/29819b88-9146-464f-a66e-915c9f4e0f28" status: 202 len: 0 microversion: 2.1 time: 0.424539 Oct 30 01:14:42.933926 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 279/566] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:14:42 2022] DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments/29819b88-9146-464f-a66e-915c9f4e0f28 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:14:44.227437 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:44.230434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:44.238175 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.238914 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.239835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.240718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.241337 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.241915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.281932 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-aa5acb2d-560c-421a-9e50-e756b028c712 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058743 Oct 30 01:14:44.282604 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 288/567] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:14:44 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:44.422284 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:44.424660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:44.431274 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.431804 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.432244 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.433535 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.433998 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.434433 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.468244 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-667fd413-5128-47f7-8a4b-59108000750b tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051605 Oct 30 01:14:44.468848 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 280/568] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:14:44 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:44.548310 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:44.560619 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:44.560619 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.560619 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.560619 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.561301 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.561301 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.561301 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.597210 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:14:44.973325 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-80cc3a32-24d9-4928-8f70-a387220b1e53 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 204 len: 0 microversion: 2.1 time: 0.429643 Oct 30 01:14:44.974136 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 289/569] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:44 2022] DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:14:44.984122 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:44.984819 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:44.992721 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.993341 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.993816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.994596 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.995088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.995543 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:45.146862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:45.156018 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0e6d32dd-a87d-4b99-ab19-8981facbdd2a tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1673 microversion: 2.1 time: 0.176516 Oct 30 01:14:45.156575 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 281/570] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:44 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:46.181709 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.182518 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:46.190173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:46.194145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:46.194145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:46.194145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:46.194145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:46.194688 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:46.348107 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:46.358558 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-dd3cf675-2049-4b72-be98-e2ef3fd476ae tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1673 microversion: 2.1 time: 0.181376 Oct 30 01:14:46.359276 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 290/571] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:46 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:47.384527 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.385194 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:47.392893 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.393463 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.393846 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.394569 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.395024 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.395450 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.621956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.631562 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-94186060-1dc4-4e9b-b810-709a98b0f3b1 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1673 microversion: 2.1 time: 0.251281 Oct 30 01:14:47.632646 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 282/572] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:47 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:48.669968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:48.671003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:48.672387 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-441c72cc-c83c-498e-85d0-43ade1772247 req-c7591f64-c17a-42ab-8eea-48b444f5c7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430780a7-f9ba-41fb-9e2d-e575994b4c22", "name": "network-vif-deleted", "tag": "44604177-fdbb-4922-88e9-3af1a4695ad5"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:48.691662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.696595 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-441c72cc-c83c-498e-85d0-43ade1772247 req-c7591f64-c17a-42ab-8eea-48b444f5c7ab service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.697298 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-441c72cc-c83c-498e-85d0-43ade1772247 req-c7591f64-c17a-42ab-8eea-48b444f5c7ab service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.697776 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.698147 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-441c72cc-c83c-498e-85d0-43ade1772247 req-c7591f64-c17a-42ab-8eea-48b444f5c7ab service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.699357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.700871 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.701993 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.702867 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.719534 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-441c72cc-c83c-498e-85d0-43ade1772247 req-c7591f64-c17a-42ab-8eea-48b444f5c7ab service nova] Creating event network-vif-deleted:44604177-fdbb-4922-88e9-3af1a4695ad5 for instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 on hv-cinder-maste Oct 30 01:14:48.730227 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-441c72cc-c83c-498e-85d0-43ade1772247 req-c7591f64-c17a-42ab-8eea-48b444f5c7ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357963 Oct 30 01:14:48.731398 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 291/573] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:48.814109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:48.830843 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b621d03a-5318-421c-aa30-75cb2f683cb9 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1322 microversion: 2.1 time: 0.174974 Oct 30 01:14:48.831951 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 283/574] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:48 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:49.861910 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:49.862589 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:49.874123 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.875052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.875922 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.877240 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.878064 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.878953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.933076 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.933559 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.934082 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.934560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lazy-loading 'fault' on Instance uuid 430780a7-f9ba-41fb-9e2d-e575994b4c22 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:49.988350 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfba439a18a4c8e8fa0021380128447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fc550e1caf445d8027e8051e0b4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.997768 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-18a79b22-89af-42f6-9f57-699867eed2dd tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 200 len: 1327 microversion: 2.1 time: 0.140387 Oct 30 01:14:49.998644 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 292/575] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:49 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 1327 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:51.023944 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.024558 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:51.032224 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.032710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.033140 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.033839 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.034291 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.034707 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.050835 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] HTTP exception thrown: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Request method failure captured: Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 HTTP/1.1 Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc7CD7EHvBHo9qW3H8Z8zKDxoCKCQXT1g2b9pP-MlnW7KPdBb5dVBwCpnevNv5jI5x6r1h0bJi2mMs8n1xbvFrrzFoZMa_-BvqaBkyRX722kqEhJYZUhUIVe_XUv2pW55Nv29HjLEniZYCCuP9Of0WG0-pMG9wzSuYN9ECTyBCos3E4 Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:14:51.052537 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 2cfba439a18a4c8e8fa0021380128447 Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:51.055026 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '430780a7-f9ba-41fb-9e2d-e575994b4c22'} Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:51.056526 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:51.058980 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.061659 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Returning 404 to user: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:51.061659 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-23ac34e5-53e5-433b-9d3e-8ee08988b7c4 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 404 len: 111 microversion: 2.1 time: 0.034149 Oct 30 01:14:51.061659 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 284/576] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:51 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:14:51.065295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5672a464-1a1b-40bc-bbda-4ffbfe485a0e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '.version_select at 0x7f0487f56f70>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.151140 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5672a464-1a1b-40bc-bbda-4ffbfe485a0e tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809857420" status: 202 len: 0 microversion: 2.1 time: 0.091184 Oct 30 01:14:51.152490 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 293/577] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Oct 30 01:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809857420 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:54.873836 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:54.874307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:54.880657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.881148 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.881612 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.882290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.882751 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.883173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.899098 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] HTTP exception thrown: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Request method failure captured: Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 HTTP/1.1 Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc7CD7EHvBHo9qW3H8Z8zKDxoCKCQXT1g2b9pP-MlnW7KPdBb5dVBwCpnevNv5jI5x6r1h0bJi2mMs8n1xbvFrrzFoZMa_-BvqaBkyRX722kqEhJYZUhUIVe_XUv2pW55Nv29HjLEniZYCCuP9Of0WG0-pMG9wzSuYN9ECTyBCos3E4 Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:14:54.900733 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 2cfba439a18a4c8e8fa0021380128447 Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.904216 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '430780a7-f9ba-41fb-9e2d-e575994b4c22'} Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:54.905721 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.913970 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.916188 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Returning 404 to user: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:54.916188 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-aeeb25ed-870b-4e37-9cbf-9fd09ff56c65 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 404 len: 111 microversion: 2.1 time: 0.033509 Oct 30 01:14:54.916188 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 285/578] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:54 2022] DELETE /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:54.916606 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:54.916606 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 430780a7-f9ba-41fb-9e2d-e575994b4c22] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:54.920901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.921321 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.921767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.922486 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.922952 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.923371 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.927289 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:54.940225 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] HTTP exception thrown: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Request method failure captured: Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 HTTP/1.1 Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc7CD7EHvBHo9qW3H8Z8zKDxoCKCQXT1g2b9pP-MlnW7KPdBb5dVBwCpnevNv5jI5x6r1h0bJi2mMs8n1xbvFrrzFoZMa_-BvqaBkyRX722kqEhJYZUhUIVe_XUv2pW55Nv29HjLEniZYCCuP9Of0WG0-pMG9wzSuYN9ECTyBCos3E4 Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:14:54.941931 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 2cfba439a18a4c8e8fa0021380128447 Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.948278 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '430780a7-f9ba-41fb-9e2d-e575994b4c22'} Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:54.949795 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. Oct 30 01:14:54.953000 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:54.954899 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Returning 404 to user: Instance 430780a7-f9ba-41fb-9e2d-e575994b4c22 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:54.954899 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7130ef05-c315-47ab-933b-c406e732b594 tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22" status: 404 len: 111 microversion: 2.1 time: 0.034940 Oct 30 01:14:54.954899 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 294/579] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:54 2022] GET /compute/v2.1/servers/430780a7-f9ba-41fb-9e2d-e575994b4c22 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:14:56.268533 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.269196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:56.278405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.278405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.278405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.278405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.278896 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.278896 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.293559 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] HTTP exception thrown: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Request method failure captured: Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: DELETE /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb HTTP/1.1 Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc7CD7EHvBHo9qW3H8Z8zKDxoCKCQXT1g2b9pP-MlnW7KPdBb5dVBwCpnevNv5jI5x6r1h0bJi2mMs8n1xbvFrrzFoZMa_-BvqaBkyRX722kqEhJYZUhUIVe_XUv2pW55Nv29HjLEniZYCCuP9Of0WG0-pMG9wzSuYN9ECTyBCos3E4 Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:14:56.295136 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 2cfba439a18a4c8e8fa0021380128447 Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.297590 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb'} Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:56.298929 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.301575 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.304240 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Returning 404 to user: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:56.304240 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fcaf2289-2ee6-41d9-9acb-80ef4cae209f tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 404 len: 111 microversion: 2.1 time: 0.032078 Oct 30 01:14:56.304240 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 286/580] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:56 2022] DELETE /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:56.308378 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.309235 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] [instance: 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:56.317474 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.318247 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.318770 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.319618 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.320184 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.320748 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.335954 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] HTTP exception thrown: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Request method failure captured: Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb HTTP/1.1 Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc7CD7EHvBHo9qW3H8Z8zKDxoCKCQXT1g2b9pP-MlnW7KPdBb5dVBwCpnevNv5jI5x6r1h0bJi2mMs8n1xbvFrrzFoZMa_-BvqaBkyRX722kqEhJYZUhUIVe_XUv2pW55Nv29HjLEniZYCCuP9Of0WG0-pMG9wzSuYN9ECTyBCos3E4 Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:14:56.337516 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82fc550e1caf445d8027e8051e0b4d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 82fc550e1caf445d8027e8051e0b4d30 Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1963003872 Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 2cfba439a18a4c8e8fa0021380128447 Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeTestJSON-1963003872-project Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.339906 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb'} Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:56.341288 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. Oct 30 01:14:56.343515 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:14:56.345932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] Returning 404 to user: Instance 4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:56.345932 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b9ef0aab-5b47-400b-beb9-8a4f696500ac tempest-AttachVolumeTestJSON-1963003872 tempest-AttachVolumeTestJSON-1963003872-project] 10.222.0.26 "GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb" status: 404 len: 111 microversion: 2.1 time: 0.037008 Oct 30 01:14:56.345932 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 295/581] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/servers/4de39b8b-1cc6-4ddf-b0b4-814fc109f6cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:10.620063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=19 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:10.620063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:10.854378 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-34e1ad4e-8a2c-4f27-bbb0-c216d3abb285 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: .version_select at 0x7f0487d073a0>, body: {"keypair": {"name": "tempest-keypair-1650161120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzWBqrHAK2GNw7C5/uQsAJa/g3HT3KsIdzJ97bX+agUeDFEzDrHn55/P1OHU27P7TEc/GdRTjRfqibJs/cw+80WQ/NRKdnFOvBhXUMAHLILTZ67vB4cPDNs+LdeA4LnUg=="}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:10.887003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-34e1ad4e-8a2c-4f27-bbb0-c216d3abb285 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:10.895083 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-34e1ad4e-8a2c-4f27-bbb0-c216d3abb285 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:11.020064 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-34e1ad4e-8a2c-4f27-bbb0-c216d3abb285 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.417267 Oct 30 01:15:11.021200 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 287/582] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:15:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:12.443727 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-962231925"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:12.444687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:12.449693 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:12.459648 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.460422 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.465156 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.465156 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.465156 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.465156 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.529738 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:12.530668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:12.542674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.543449 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.544181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.545370 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.545975 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.546510 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.592687 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8b5c9b50-37e0-4bce-908e-2da322639035 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/ips" status: 200 len: 151 microversion: 2.20 time: 0.070861 Oct 30 01:15:12.595945 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 288/583] 10.222.0.26 () {60 vars in 1289 bytes} [Sun Oct 30 01:15:12 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:15:12.777981 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.network.security_group_api [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Removing security group 9d8cb7d8-fa55-49f4-a812-aebd81ac7376 from port 4e38f9d6-0235-42f8-8ef7-c7a4b4344058 Oct 30 01:15:13.452796 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1afdc27b-3481-419e-a7ee-54a0d38520c4 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/action" status: 202 len: 0 microversion: 2.1 time: 1.015072 Oct 30 01:15:13.455474 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 296/584] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:12 2022] POST /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/action => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:15:13.498651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-b52ac48a-10eb-4bbc-a99c-ba90d711e3eb req-71b4e2e6-1561-47f7-b6ac-205bd27e0454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6eed76-f803-4a8e-8890-5d899eca8800", "tag": "4e38f9d6-0235-42f8-8ef7-c7a4b4344058"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:13.518164 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-b52ac48a-10eb-4bbc-a99c-ba90d711e3eb req-71b4e2e6-1561-47f7-b6ac-205bd27e0454 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.530421 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-b52ac48a-10eb-4bbc-a99c-ba90d711e3eb req-71b4e2e6-1561-47f7-b6ac-205bd27e0454 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.530421 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-b52ac48a-10eb-4bbc-a99c-ba90d711e3eb req-71b4e2e6-1561-47f7-b6ac-205bd27e0454 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.548580 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-b52ac48a-10eb-4bbc-a99c-ba90d711e3eb req-71b4e2e6-1561-47f7-b6ac-205bd27e0454 service nova] Creating event network-changed:4e38f9d6-0235-42f8-8ef7-c7a4b4344058 for instance 7a6eed76-f803-4a8e-8890-5d899eca8800 on hv-cinder-maste Oct 30 01:15:13.559852 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-b52ac48a-10eb-4bbc-a99c-ba90d711e3eb req-71b4e2e6-1561-47f7-b6ac-205bd27e0454 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070384 Oct 30 01:15:13.561957 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 289/585] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:15.229946 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-833423706", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "843e4324-5c32-4e7f-add7-0c4eec3b7e77"}], "security_groups": [{"name": "tempest-securitygroup--1109591576"}], "key_name": "tempest-keypair-1650161120", "user_data": "}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:15.388791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] validate_networks() for [('843e4324-5c32-4e7f-add7-0c4eec3b7e77', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:15.515865 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:15.517464 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:15.528748 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:15.530137 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:15.531004 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:15.532484 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:15.533448 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:15.534324 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:15.583887 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lazy-loading 'flavor' on Instance uuid a61f5ece-c472-4444-b1e0-365185ebf03f {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:16.190288 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:16.190704 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:16.191171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:16.191568 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:16.192039 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:16.202838 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.203320 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.203787 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.204510 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.204957 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.205587 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.224574 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:16.229207 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:16.242082 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:16.244988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:16.296714 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-99c903ee-179b-4042-845b-3b5be370a453 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/action" status: 202 len: 0 microversion: 2.20 time: 0.785662 Oct 30 01:15:16.298132 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 290/586] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 30 01:15:15 2022] POST /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:15:16.326939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.328111 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:16.343498 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.344927 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.345935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.347631 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.348626 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.352782 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.417648 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ee0ad721-dc4f-4dee-8232-0b50dca00410 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.197203 Oct 30 01:15:16.425564 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 297/587] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:16.606237 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lazy-loading 'services' on Instance uuid 7a6eed76-f803-4a8e-8890-5d899eca8800 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:16.624743 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-6451a0c2-99ff-43f6-b5f7-5f510198e6b9 req-6a05d8de-64fa-4d17-9c88-88171c39c6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6eed76-f803-4a8e-8890-5d899eca8800", "tag": "4e38f9d6-0235-42f8-8ef7-c7a4b4344058"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:16.637256 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-6451a0c2-99ff-43f6-b5f7-5f510198e6b9 req-6a05d8de-64fa-4d17-9c88-88171c39c6ac service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.638677 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-6451a0c2-99ff-43f6-b5f7-5f510198e6b9 req-6a05d8de-64fa-4d17-9c88-88171c39c6ac service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.639295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-6451a0c2-99ff-43f6-b5f7-5f510198e6b9 req-6a05d8de-64fa-4d17-9c88-88171c39c6ac service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.674505 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-6451a0c2-99ff-43f6-b5f7-5f510198e6b9 req-6a05d8de-64fa-4d17-9c88-88171c39c6ac service nova] Creating event network-changed:4e38f9d6-0235-42f8-8ef7-c7a4b4344058 for instance 7a6eed76-f803-4a8e-8890-5d899eca8800 on hv-cinder-maste Oct 30 01:15:16.690857 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-6451a0c2-99ff-43f6-b5f7-5f510198e6b9 req-6a05d8de-64fa-4d17-9c88-88171c39c6ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263394 Oct 30 01:15:16.691967 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 298/588] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:16.704168 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.705738 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:16.716576 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.717411 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.718166 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.719962 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.720202 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.720939 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.951023 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-67bea0b7-0fdf-414a-aa00-25f24760aeff tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments/6fa4eb15-956b-4e8c-946c-4348ff904052" status: 202 len: 0 microversion: 2.1 time: 0.636015 Oct 30 01:15:16.951889 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 291/589] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:15:16 2022] DELETE /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments/6fa4eb15-956b-4e8c-946c-4348ff904052 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:16.968081 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-09ad31f4-d535-4233-a65d-839231e14bfe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.970326 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-09ad31f4-d535-4233-a65d-839231e14bfe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:17.088433 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-09ad31f4-d535-4233-a65d-839231e14bfe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:17.105246 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-09ad31f4-d535-4233-a65d-839231e14bfe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1241 microversion: 2.1 time: 0.149875 Oct 30 01:15:17.105893 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 292/590] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:17.121184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:17.125322 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:17.134691 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:17.135464 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:17.136143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:17.137559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:17.138675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:17.138675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:17.161627 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:17.174483 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:17.178139 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:17.180458 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-98834829-b5a2-47e1-83af-5793485461e3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.485673 Oct 30 01:15:17.180911 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 299/591] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:17.232025 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-93a09a22-5f5d-4406-bf7d-6f3358d4117b tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124547 Oct 30 01:15:17.233127 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 293/592] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:15:17 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:18.141894 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-eed4130c-8240-44f1-bfe3-efb2cdcbfe8d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.142508 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-eed4130c-8240-44f1-bfe3-efb2cdcbfe8d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:18.203891 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-eed4130c-8240-44f1-bfe3-efb2cdcbfe8d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.212564 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-eed4130c-8240-44f1-bfe3-efb2cdcbfe8d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1241 microversion: 2.1 time: 0.075081 Oct 30 01:15:18.212792 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.213496 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 300/593] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:18.213719 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:18.226424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.227202 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.227925 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.230020 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.230889 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.232156 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.249397 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.252290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:18.259845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.260769 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.261367 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.262176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.262688 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.263126 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.303919 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f8caba6a-d97a-4a29-8254-ce71b87b4e76 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058532 Oct 30 01:15:18.305152 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 301/594] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:15:18.319460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.320286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:18.330866 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.331562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.332433 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.334782 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.335456 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.336245 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.422240 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.434953 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.438866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.438866 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d4a8ce3a-d1b0-4e34-aaef-c53b3750f6f8 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.234914 Oct 30 01:15:18.439992 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 294/595] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:18.488428 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] HTTP exception thrown: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 is not attached to volume 6fa4eb15-956b-4e8c-946c-4348ff904052 Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Request method failure captured: Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: DELETE /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments/6fa4eb15-956b-4e8c-946c-4348ff904052 HTTP/1.1 Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc-GRvOs9ckxDsV_dflBZvLXneaBZsHGG2Rm330Aix15ES4ldl4DVJ1mxCnibn43TjYz4LTtpysTXyhK8dXLuLg2PVJrA9UUb3wi0BiGt_Dg4Bv1Db9IuTX8Qq5el3kXga-baFl6CMWF9u9NX76OTmvdY04b5JVUWWaazvthN8uQYwg Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 77968fc2b85349b2a625ea9bf25cd026 Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-TestMinimumBasicScenario-1192201287 Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:15:18.490998 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-TestMinimumBasicScenario-1192201287 Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 77968fc2b85349b2a625ea9bf25cd026 Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1192201287 Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-TestMinimumBasicScenario-1192201287-project Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: efbfd82026f14adb91bead1b95154448 Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-TestMinimumBasicScenario-1192201287-project Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:15:18.492785 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 is not attached to volume 6fa4eb15-956b-4e8c-946c-4348ff904052 Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'server_id': '7a6eed76-f803-4a8e-8890-5d899eca8800', 'id': '6fa4eb15-956b-4e8c-946c-4348ff904052'} Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6fa4eb15-956b-4e8c-946c-4348ff904052. Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:18.494085 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 is not attached to volume 6fa4eb15-956b-4e8c-946c-4348ff904052 Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 is not attached to volume 6fa4eb15-956b-4e8c-946c-4348ff904052 Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:18.495680 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Returning 404 to user: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 is not attached to volume 6fa4eb15-956b-4e8c-946c-4348ff904052 {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:18.496655 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f7e76994-de1c-4f15-b52f-bcdd019d88c0 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments/6fa4eb15-956b-4e8c-946c-4348ff904052" status: 404 len: 154 microversion: 2.1 time: 0.180455 Oct 30 01:15:18.496655 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 302/596] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:15:18 2022] DELETE /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800/os-volume_attachments/6fa4eb15-956b-4e8c-946c-4348ff904052 => generated 154 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:15:19.241212 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:19.241982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:19.249601 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.250093 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.250537 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.251247 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.251735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.252158 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.333516 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:19.345925 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fe3e7b10-d29c-4551-9fcc-88644f29cec5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1293 microversion: 2.1 time: 0.109024 Oct 30 01:15:19.346978 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 295/597] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:19 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:19.466511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:19.467256 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:19.474061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.474552 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.474981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.475722 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.476173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.476594 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.648297 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:19.659231 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:19.661036 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:19.662383 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-28c1caa2-58c6-4f98-83f6-f0ba09893ce0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.201210 Oct 30 01:15:19.662965 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 303/598] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:19 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:19.829594 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:19.834293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:19.838978 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.839683 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.840288 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.841123 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.841713 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.842233 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.871204 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:15:20.388367 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:20.388984 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:20.395518 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.396103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.396543 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.397460 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.402527 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9dc5e55a-6639-4021-8211-3369b3ef0ff9 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 204 len: 0 microversion: 2.1 time: 0.578009 Oct 30 01:15:20.406615 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.407170 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.407700 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 296/599] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:15:19 2022] DELETE /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:15:20.421716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:20.422580 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:20.434661 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.435747 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.436668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.438662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.439244 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.439848 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.513936 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.524643 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-43ba6932-314b-49d9-bb64-c475c01a2f2d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1299 microversion: 2.1 time: 0.140779 Oct 30 01:15:20.526047 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 304/600] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:20 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:20.690207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.703106 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:20.704628 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6afab684-8d91-41d2-9eac-7b59e6f767fb tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1555 microversion: 2.1 time: 0.291789 Oct 30 01:15:20.704852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:20.705293 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 297/601] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:20 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:20.716394 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.717294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.718201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.719407 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.720294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.721070 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.966374 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.982833 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.987001 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.989730 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-dc21de8a-086c-4d1b-a420-13c1ef8b4dd4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.295807 Oct 30 01:15:20.990820 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 305/602] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:20 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:21.550752 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.551405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:21.558244 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.558737 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.559176 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.559933 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.560390 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.560809 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.715302 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:21.723528 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3a1e4f36-f4df-4046-bcd7-c0100eeaecbe tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.176660 Oct 30 01:15:21.724151 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 298/603] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:21.742882 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.743567 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:21.750417 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.750902 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.751345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.752088 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.752542 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.752972 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.902210 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:21.910771 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0458f23f-6a9b-4423-b3cb-53684518cdc7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1555 microversion: 2.1 time: 0.171805 Oct 30 01:15:21.911406 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 306/604] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:22.023784 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:22.025810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:22.037957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.040014 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.040633 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.041467 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.042086 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.042722 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.302220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:22.312477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:22.313994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:22.316328 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-dd159f0d-77c7-46a2-8bb5-853719e56ab9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.302120 Oct 30 01:15:22.316938 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 299/605] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:22 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:22.763206 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:22.764124 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:22.772498 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.773297 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.773967 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.775016 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.775630 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.776205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.939071 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:22.941315 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:22.953201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.954078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.954860 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.956161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.956985 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.957702 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.128200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:23.138205 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e9dacc6f-7d90-4e4d-add9-926e7680a552 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.379330 Oct 30 01:15:23.139256 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 307/606] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:22 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:23.320159 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:23.330929 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2fdf0e4c-c4c6-4a28-a94e-8c3661050d0a tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1555 microversion: 2.1 time: 0.398867 Oct 30 01:15:23.331650 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 300/607] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:22 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1555 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:23.364546 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:23.365991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:23.373304 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-6baa1ba1-19c5-4b35-918a-99aed62a512b req-202f3f69-feab-4108-8bc9-6a5fff363440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6eed76-f803-4a8e-8890-5d899eca8800", "name": "network-vif-deleted", "tag": "4e38f9d6-0235-42f8-8ef7-c7a4b4344058"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:23.377182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.378066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.378804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.380093 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.381126 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.381840 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.392522 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-6baa1ba1-19c5-4b35-918a-99aed62a512b req-202f3f69-feab-4108-8bc9-6a5fff363440 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.393509 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-6baa1ba1-19c5-4b35-918a-99aed62a512b req-202f3f69-feab-4108-8bc9-6a5fff363440 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.394355 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-6baa1ba1-19c5-4b35-918a-99aed62a512b req-202f3f69-feab-4108-8bc9-6a5fff363440 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.416989 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-6baa1ba1-19c5-4b35-918a-99aed62a512b req-202f3f69-feab-4108-8bc9-6a5fff363440 service nova] Creating event network-vif-deleted:4e38f9d6-0235-42f8-8ef7-c7a4b4344058 for instance 7a6eed76-f803-4a8e-8890-5d899eca8800 on hv-cinder-maste Oct 30 01:15:23.426118 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-6baa1ba1-19c5-4b35-918a-99aed62a512b req-202f3f69-feab-4108-8bc9-6a5fff363440 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059093 Oct 30 01:15:23.427925 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 301/608] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:23.716702 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:23.734896 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:23.738215 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:23.739937 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d9ea26af-7417-493e-bf85-31f418af7468 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.384613 Oct 30 01:15:23.744156 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 308/609] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:23 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:24.169231 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.170070 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:24.177800 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.178518 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.179103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.180005 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.180783 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.182129 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.371550 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.372194 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:24.380278 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.380843 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.381421 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.382399 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.383004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.383571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.422423 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.423136 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.424003 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.424553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lazy-loading 'fault' on Instance uuid 7a6eed76-f803-4a8e-8890-5d899eca8800 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:24.496739 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.501299 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:24.506730 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b8295466-a96e-4925-a63c-ac3a153dd319 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.343676 Oct 30 01:15:24.507526 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 302/610] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:24 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:24.515731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbfd82026f14adb91bead1b95154448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77968fc2b85349b2a625ea9bf25cd026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.530701 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-955cd619-6e64-49d1-b957-ee1bc9c293b2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 200 len: 1349 microversion: 2.1 time: 0.163704 Oct 30 01:15:24.532557 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 309/611] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:24 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 1349 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:24.772851 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.773541 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:24.781051 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.781532 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.781956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.782648 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.783092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.783500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.970098 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.979674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.981136 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.982310 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f3dd14fe-c993-4c4d-bacb-fd5bfa0a136d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.214319 Oct 30 01:15:24.982880 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 303/612] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:24 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:25.443235 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-5b76f6ed-8111-4c4a-b7c5-ea8c9137aae2 req-e15c1d21-03ad-413e-abc8-d0ef42048e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc02e945-abfb-4689-b7b1-753df25b5f53", "tag": "0b17abf8-3601-4323-b7df-62e623f6a142"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:25.454621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-5b76f6ed-8111-4c4a-b7c5-ea8c9137aae2 req-e15c1d21-03ad-413e-abc8-d0ef42048e13 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.455160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-5b76f6ed-8111-4c4a-b7c5-ea8c9137aae2 req-e15c1d21-03ad-413e-abc8-d0ef42048e13 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.455746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-5b76f6ed-8111-4c4a-b7c5-ea8c9137aae2 req-e15c1d21-03ad-413e-abc8-d0ef42048e13 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.468761 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-5b76f6ed-8111-4c4a-b7c5-ea8c9137aae2 req-e15c1d21-03ad-413e-abc8-d0ef42048e13 service nova] Creating event network-changed:0b17abf8-3601-4323-b7df-62e623f6a142 for instance bc02e945-abfb-4689-b7b1-753df25b5f53 on hv-cinder-maste Oct 30 01:15:25.474099 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-5b76f6ed-8111-4c4a-b7c5-ea8c9137aae2 req-e15c1d21-03ad-413e-abc8-d0ef42048e13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034764 Oct 30 01:15:25.474719 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 310/613] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:25.542441 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.543098 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:25.550173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.551271 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.551781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.552513 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.552969 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.553388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.572571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.573872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] [instance: 7a6eed76-f803-4a8e-8890-5d899eca8800] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:25.580904 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.581403 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.581840 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.582576 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.583040 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.583463 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.598485 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] HTTP exception thrown: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 could not be found. Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Request method failure captured: Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 HTTP/1.1 Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc-GRvOs9ckxDsV_dflBZvLXneaBZsHGG2Rm330Aix15ES4ldl4DVJ1mxCnibn43TjYz4LTtpysTXyhK8dXLuLg2PVJrA9UUb3wi0BiGt_Dg4Bv1Db9IuTX8Qq5el3kXga-baFl6CMWF9u9NX76OTmvdY04b5JVUWWaazvthN8uQYwg Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 77968fc2b85349b2a625ea9bf25cd026 Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-TestMinimumBasicScenario-1192201287 Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:15:25.600226 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/77968fc2b85349b2a625ea9bf25cd026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-TestMinimumBasicScenario-1192201287 Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 77968fc2b85349b2a625ea9bf25cd026 Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1192201287 Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-TestMinimumBasicScenario-1192201287-project Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: efbfd82026f14adb91bead1b95154448 Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-TestMinimumBasicScenario-1192201287-project Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 could not be found. Oct 30 01:15:25.603471 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '7a6eed76-f803-4a8e-8890-5d899eca8800'} Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 could not be found. Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:25.605349 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 could not be found. Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 could not be found. Oct 30 01:15:25.614302 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:15:25.616795 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Returning 404 to user: Instance 7a6eed76-f803-4a8e-8890-5d899eca8800 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:25.616795 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c7b483e3-df26-4b9f-a5ca-1b5f02e19ee2 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800" status: 404 len: 111 microversion: 2.1 time: 0.037890 Oct 30 01:15:25.616795 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 311/614] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:25 2022] GET /compute/v2.1/servers/7a6eed76-f803-4a8e-8890-5d899eca8800 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:25.616795 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6e5582b8-207d-4e57-8b10-b859a15656d7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] Calling method '.version_select at 0x7f0487e7a550>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.721618 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6e5582b8-207d-4e57-8b10-b859a15656d7 tempest-TestMinimumBasicScenario-1192201287 tempest-TestMinimumBasicScenario-1192201287-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2051045956" status: 202 len: 0 microversion: 2.1 time: 0.113061 Oct 30 01:15:25.722546 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 312/615] 10.222.0.26 () {58 vars in 1272 bytes} [Sun Oct 30 01:15:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2051045956 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:25.785838 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:25.800893 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1b9aaad8-fcf2-4ab6-94e8-3ba5362863d9 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.262299 Oct 30 01:15:25.805024 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 304/616] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:25 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:26.008663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:26.009320 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.016254 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.017054 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.017788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.018688 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.019342 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.019962 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.213237 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:26.289087 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.303123 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.306363 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.308795 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-af1e56a7-cb5e-4f2f-8de8-4a0d8baa9e5f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.303726 Oct 30 01:15:26.310322 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 313/617] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:26 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:26.829702 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:26.830758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.842288 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.848357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.848357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.848357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.848357 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.848934 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.047097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.062889 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c627f4c9-837b-4020-a048-35767a33716d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.239144 Oct 30 01:15:27.064495 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 305/618] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:26 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:27.345145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:27.348316 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:27.360590 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.361236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.362858 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.364566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.365320 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.365853 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.640161 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.651070 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.653039 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.654458 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0f189ca8-0d9e-454c-975a-ceffd4fd1d67 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.317244 Oct 30 01:15:27.668226 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 314/619] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:27 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:28.092744 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.094380 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:28.100077 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:28.107882 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.108894 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.109577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.110455 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.111072 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.111650 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.344453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:28.358374 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bcb8677e-ac3e-455c-ab39-c2f619069157 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.273272 Oct 30 01:15:28.359433 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 306/620] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:28.687997 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.689093 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:28.698466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=8 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:28.703474 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.704393 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.705254 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.706732 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.707613 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.708442 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.013457 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.030329 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.032980 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.034668 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a584d3b6-dd0c-422a-b735-01cf367df021 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.354601 Oct 30 01:15:29.036466 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 315/621] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:29.386173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:29.387142 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:29.415731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.418562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.418562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.424341 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.426067 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.427103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.435998 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-940d841d-0a9c-4c3b-942d-36e800da9eed req-1043fa53-687f-4e87-a95d-02814c3eb48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc02e945-abfb-4689-b7b1-753df25b5f53", "name": "network-vif-plugged", "status": "completed", "tag": "0b17abf8-3601-4323-b7df-62e623f6a142"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:29.458230 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-940d841d-0a9c-4c3b-942d-36e800da9eed req-1043fa53-687f-4e87-a95d-02814c3eb48c service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.458987 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-940d841d-0a9c-4c3b-942d-36e800da9eed req-1043fa53-687f-4e87-a95d-02814c3eb48c service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.459853 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-940d841d-0a9c-4c3b-942d-36e800da9eed req-1043fa53-687f-4e87-a95d-02814c3eb48c service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.490430 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-940d841d-0a9c-4c3b-942d-36e800da9eed req-1043fa53-687f-4e87-a95d-02814c3eb48c service nova] Creating event network-vif-plugged:0b17abf8-3601-4323-b7df-62e623f6a142 for instance bc02e945-abfb-4689-b7b1-753df25b5f53 on hv-cinder-maste Oct 30 01:15:29.499618 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-940d841d-0a9c-4c3b-942d-36e800da9eed req-1043fa53-687f-4e87-a95d-02814c3eb48c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179531 Oct 30 01:15:29.503537 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 307/622] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:29.742573 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.756633 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=100 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:29.761017 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-07463977-0132-43f4-866a-01f19b8d8562 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.379356 Oct 30 01:15:29.762101 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 316/623] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:29 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:30.068000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:30.068000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:30.072740 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.073192 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.073613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.074422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.074906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.075454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.374031 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.385587 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.387227 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.389160 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-cd8d3a1c-1302-441c-b191-7bf071e9a2dc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.329870 Oct 30 01:15:30.389950 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 308/624] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:30 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:30.790831 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:30.791921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:30.805423 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.806484 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.807012 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.807965 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.810694 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.811375 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.342761 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:31.358191 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-cb3072c0-182b-4657-862e-755d3cdb0406 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1367 microversion: 2.1 time: 0.571822 Oct 30 01:15:31.359254 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 317/625] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:30 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:31.420417 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:31.421548 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:31.435183 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.436195 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.437004 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.438329 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.439313 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.440122 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.764732 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:31.776116 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:31.778061 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:31.779675 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-17171428-5993-4bd8-8292-28a118884e8c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.367508 Oct 30 01:15:31.792525 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 309/626] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:31 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:32.393499 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:32.394535 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:32.409357 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.410525 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.411817 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.413323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.414362 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.415949 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.689892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:32.699787 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-934f63b2-05be-41c2-a15a-876ed9fe1506 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1556 microversion: 2.1 time: 0.311676 Oct 30 01:15:32.700600 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 318/627] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:32 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1556 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:32.732407 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:32.733342 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:32.746108 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.746981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.747855 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.749163 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.750028 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.750810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.810149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:32.811432 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:32.822774 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.823431 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.823995 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.825165 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.826127 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.826905 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.945769 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0be7191e-c6cd-419b-bfc8-22ad7c3815bd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222256 Oct 30 01:15:32.946486 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 310/628] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:15:32 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:33.091987 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:33.113934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:33.116600 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:33.118425 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-badc3e89-d233-4fbc-b740-2a99e9de8c2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.315582 Oct 30 01:15:33.124526 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 319/629] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:32 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:34.155399 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:34.160162 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:34.174873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.176169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.177615 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.179361 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.181375 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.182475 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.410588 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-be8066fe-cac0-4256-ab78-c3be1eaaf079 req-359a5788-31b4-4751-9bd5-a6a3f449c3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc02e945-abfb-4689-b7b1-753df25b5f53", "tag": "0b17abf8-3601-4323-b7df-62e623f6a142"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:34.431452 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-be8066fe-cac0-4256-ab78-c3be1eaaf079 req-359a5788-31b4-4751-9bd5-a6a3f449c3bc service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.432252 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-be8066fe-cac0-4256-ab78-c3be1eaaf079 req-359a5788-31b4-4751-9bd5-a6a3f449c3bc service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.432874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-be8066fe-cac0-4256-ab78-c3be1eaaf079 req-359a5788-31b4-4751-9bd5-a6a3f449c3bc service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.454720 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-be8066fe-cac0-4256-ab78-c3be1eaaf079 req-359a5788-31b4-4751-9bd5-a6a3f449c3bc service nova] Creating event network-changed:0b17abf8-3601-4323-b7df-62e623f6a142 for instance bc02e945-abfb-4689-b7b1-753df25b5f53 on hv-cinder-maste Oct 30 01:15:34.466932 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-be8066fe-cac0-4256-ab78-c3be1eaaf079 req-359a5788-31b4-4751-9bd5-a6a3f449c3bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060848 Oct 30 01:15:34.470978 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 320/630] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:15:34.608835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.626130 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.630114 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.631963 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a6fca2c9-b21a-4c80-b5cf-25a457b0a405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.484653 Oct 30 01:15:34.632846 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 311/631] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:34 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:35.682560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:35.683856 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:35.704352 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.705089 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.705858 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.706879 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.707692 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.708492 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.072541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.094451 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.098065 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.101019 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9c9042e9-b0e6-4e22-90e0-27a981d0ca2f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.438118 Oct 30 01:15:36.105580 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 321/632] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:37.147001 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:37.147810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:37.155893 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.156660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.157255 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.158140 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.159235 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.159960 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.352221 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:37.364265 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:37.366567 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:37.368804 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e507b815-70a9-4b6f-bc2a-ad11c3a5813f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.225838 Oct 30 01:15:37.370527 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 312/633] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:37 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:38.397263 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:38.397874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:38.410810 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.411309 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.411780 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.412509 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.412976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.413484 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.635204 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.644418 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.645934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.647055 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a1514d50-e62d-48bb-8e50-0672865c7360 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1742 microversion: 2.20 time: 0.253817 Oct 30 01:15:38.647659 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 322/634] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:38 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1742 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:39.693108 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:39.695089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:39.707810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.707810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.707810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.707810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.708165 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.708165 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.893216 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.907728 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.909986 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.911951 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-02492eb6-d12e-4b7e-abd2-f0e4edb8b97e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.223376 Oct 30 01:15:39.912801 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 313/635] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:39 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:40.945915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:40.948419 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:40.964300 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.966675 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.968173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.970225 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.971467 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.972608 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.219914 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.231646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.233391 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.235143 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a448742e-fc7c-48d0-8bf0-0752d03c46b9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.298375 Oct 30 01:15:41.236246 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 323/636] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:40 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:41.298993 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-cfe55d72-8948-4dee-81d7-933d2afdd812 req-703b169b-2e37-4920-902b-95c274321f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61f5ece-c472-4444-b1e0-365185ebf03f", "name": "network-vif-plugged", "status": "completed", "tag": "1d6fd425-3461-45ae-8efb-bc1ff24c309a"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:41.314381 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:41.322131 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-cfe55d72-8948-4dee-81d7-933d2afdd812 req-703b169b-2e37-4920-902b-95c274321f0b service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.323079 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-cfe55d72-8948-4dee-81d7-933d2afdd812 req-703b169b-2e37-4920-902b-95c274321f0b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.323893 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-cfe55d72-8948-4dee-81d7-933d2afdd812 req-703b169b-2e37-4920-902b-95c274321f0b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.349534 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-cfe55d72-8948-4dee-81d7-933d2afdd812 req-703b169b-2e37-4920-902b-95c274321f0b service nova] Creating event network-vif-plugged:1d6fd425-3461-45ae-8efb-bc1ff24c309a for instance a61f5ece-c472-4444-b1e0-365185ebf03f on hv-cinder-maste Oct 30 01:15:41.356533 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-cfe55d72-8948-4dee-81d7-933d2afdd812 req-703b169b-2e37-4920-902b-95c274321f0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063816 Oct 30 01:15:41.357563 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 314/637] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:42.281549 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.282510 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.299094 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.300022 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.300916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.302179 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.302981 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.303735 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.635846 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.646785 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.654002 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.657412 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2c7aded0-a834-42ee-8b60-2d65aa18fb7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.381488 Oct 30 01:15:42.660524 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 324/638] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:43.700093 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:43.702704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:43.719396 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.720240 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.720947 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.721906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.722609 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.723259 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.894773 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:43.905001 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:43.906463 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:43.907676 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-306dde61-2dd8-425b-b6e9-159e56ff3c78 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.219705 Oct 30 01:15:43.908231 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 315/639] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:43 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:44.943774 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:44.945059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:44.956781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:44.960328 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.961361 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.962472 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.967481 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.967481 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.967481 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.252224 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.262561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.264655 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.268693 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6e371a53-ad46-4190-a226-8eb7bda7e50d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.333117 Oct 30 01:15:45.270089 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 325/640] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:44 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:46.318993 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:46.318993 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.321067 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.321773 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.322431 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.324066 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.324766 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.325369 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.634702 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.653455 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.655085 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.656351 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6a0a82ed-5a6e-4309-ad1a-e42263c26572 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.349336 Oct 30 01:15:46.657515 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 316/641] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:46 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:47.694870 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:47.696381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:47.709024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.710041 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.710752 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.712035 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.712793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.713499 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.099222 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.121791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.125961 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.128455 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-135c2ae9-6de3-477b-bca3-13b8ca150a7a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.442961 Oct 30 01:15:48.129984 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 326/642] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:47 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:49.154696 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:49.155293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:49.162050 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.162546 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.162984 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.163727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.164736 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.165169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.477767 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.497327 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.499812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.501347 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-83a34f69-1213-4572-96fb-a11f4abeb046 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.350603 Oct 30 01:15:49.502168 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 317/643] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:49 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:50.534234 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:50.537812 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:50.592273 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.598948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.607742 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.609932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.618889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.620330 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.443195 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.456121 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.457791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.462299 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2dc160d2-0ec9-44b5-8acf-c0ef5445b5d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.936296 Oct 30 01:15:51.476034 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 327/644] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:50 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:52.508969 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.510380 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:52.530864 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.531743 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.532552 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.537918 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.538802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.544000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.858579 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.868879 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.879219 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.894439 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1cd885b1-228c-49c1-9167-de4ae59ac469 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.404042 Oct 30 01:15:52.899773 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 318/645] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:53.944204 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:53.945075 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:53.966832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.966832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.966832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.966832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.967495 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.967495 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:54.128191 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:54.139471 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:54.141037 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:54.142316 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3a00a5ef-29fd-4b81-8d87-c6628b1f27de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.203187 Oct 30 01:15:54.142964 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 328/646] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:53 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:55.187377 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:55.189803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:55.228383 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.228799 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.229242 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.229975 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.230437 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.230898 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.251859 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=87 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:55.499889 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.509594 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.511068 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.512361 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-568356fc-e799-4040-91bf-716c622602aa tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.331076 Oct 30 01:15:55.513015 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 319/647] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:55 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:56.545529 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:56.546775 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:56.560104 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.561091 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.562199 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.563646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.564555 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.565691 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.980847 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:57.002426 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:57.006613 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:57.010395 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ab2e8968-0927-4477-9d5b-0dd41afb4a8a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1737 microversion: 2.20 time: 0.472224 Oct 30 01:15:57.013225 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 329/648] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:56 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1737 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:58.051779 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:58.053208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:58.062131 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.062625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.063092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.063835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.064304 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.064713 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.631307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:58.650528 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:58.652740 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:58.654706 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-48d53087-6292-44b3-a947-954b52119460 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1719 microversion: 2.20 time: 0.607412 Oct 30 01:15:58.655356 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 320/649] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:58 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1719 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:59.689958 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:59.690924 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:59.703012 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.704416 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.705232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.706251 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.707131 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.707913 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.014658 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:00.033116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:00.039725 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:00.046317 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a1f80b85-67af-49f2-a58a-a65d1fafe323 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1719 microversion: 2.20 time: 0.360765 Oct 30 01:16:00.047810 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 330/650] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:59 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1719 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:01.081125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.087577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:01.098660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.099151 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.099579 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.100551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.101422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.101849 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.398489 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-17c87f28-f103-4e58-a0ca-9125ea12ebbe req-7ea56e6e-7077-4f46-a77e-bc6e7e366dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61f5ece-c472-4444-b1e0-365185ebf03f", "name": "network-vif-unplugged", "status": "completed", "tag": "1d6fd425-3461-45ae-8efb-bc1ff24c309a"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:01.399524 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.416174 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-17c87f28-f103-4e58-a0ca-9125ea12ebbe req-7ea56e6e-7077-4f46-a77e-bc6e7e366dd2 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.417071 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-17c87f28-f103-4e58-a0ca-9125ea12ebbe req-7ea56e6e-7077-4f46-a77e-bc6e7e366dd2 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.417487 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.418041 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-17c87f28-f103-4e58-a0ca-9125ea12ebbe req-7ea56e6e-7077-4f46-a77e-bc6e7e366dd2 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.421008 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.424806 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c2e7ade9-43fb-4aaa-af08-cf83511669c4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1722 microversion: 2.20 time: 0.352458 Oct 30 01:16:01.424985 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=82 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:01.425763 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 321/651] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:01.435741 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.compute.server_external_events [req-17c87f28-f103-4e58-a0ca-9125ea12ebbe req-7ea56e6e-7077-4f46-a77e-bc6e7e366dd2 service nova] Unable to find a host for instance a61f5ece-c472-4444-b1e0-365185ebf03f. Dropping event network-vif-unplugged {{(pid=119524) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 01:16:01.441024 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-17c87f28-f103-4e58-a0ca-9125ea12ebbe req-7ea56e6e-7077-4f46-a77e-bc6e7e366dd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043061 Oct 30 01:16:01.441024 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 331/652] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 30 01:16:01.472663 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e710b03-6a9f-42b9-93e2-55f9309a4e2a"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:01.475214 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:01.482101 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.482840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.483283 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.484046 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.484785 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.485396 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:02.946444 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7b2c0bf8-5d9f-4dda-b870-b8342cae5260 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.479635 Oct 30 01:16:02.947407 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 322/653] 10.222.0.26 () {62 vars in 1364 bytes} [Sun Oct 30 01:16:01 2022] POST /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments => generated 188 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:16:03.040653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ca8eb871-d870-4ee5-b71a-59b0081a84ff tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Action: 'create', calling method: .version_select at 0x7f0487dc6dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1317867039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQIgbFUJvjaJXjd0xcnDzjI9Bs9ouI3KKk36+c/BdFdZ1Nm5loVOFRVat5o03YR2SNHo9PF0qg4r6XNVGY+0VSIN2WBxXpXP/1jvURRa0w3qq5y480+Pk+6LpUosuLnig=="}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:03.071715 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-ca8eb871-d870-4ee5-b71a-59b0081a84ff tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Getting quotas for project 55f0064a8bc14f30b2749047dfd2f53d. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:03.079304 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-ca8eb871-d870-4ee5-b71a-59b0081a84ff tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Getting quotas for user 4af60a16a7c24542b5b8aa94d2bfe9ef and project 55f0064a8bc14f30b2749047dfd2f53d. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:03.095131 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:03.095749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:03.103743 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.104237 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.104670 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.105372 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.105827 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.106248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.171428 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ca8eb871-d870-4ee5-b71a-59b0081a84ff tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.390592 Oct 30 01:16:03.172346 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 332/654] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:16:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:16:03.272738 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119523) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:16:03.688051 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ac386f4a-f1be-49c7-b886-25a8068d6b13 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/action" status: 202 len: 0 microversion: 2.20 time: 0.597054 Oct 30 01:16:03.688793 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 323/655] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 30 01:16:03 2022] POST /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:16:03.702289 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:03.705862 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:03.718255 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.719553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.720239 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.721264 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.721913 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.722533 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.937304 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:03.950794 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:03.953345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:03.955852 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4c32c1d6-7d08-4a1b-ade4-9a1500bedee7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1748 microversion: 2.20 time: 0.261511 Oct 30 01:16:03.958220 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 333/656] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:03 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1748 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:04.999919 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:05.000746 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:05.008980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.009847 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.011126 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.012260 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.013234 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.013909 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.246164 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.261367 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.263405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.264992 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f7c35a44-a373-4fdd-96ff-c1bd6522517a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1748 microversion: 2.20 time: 0.269644 Oct 30 01:16:05.266379 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 324/657] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:04 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1748 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:06.303340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:06.305141 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:06.313646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.314722 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.315375 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.316664 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.317477 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.318228 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.582511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:06.611779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:06.616145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:06.618493 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-808e46ff-b327-45fa-8331-9ff47d9e4dc5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1750 microversion: 2.20 time: 0.320145 Oct 30 01:16:06.619533 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 334/658] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:06 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1750 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:07.645291 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:07.645962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:07.653653 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.655331 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.655331 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:07.655676 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.656076 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.656500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:07.836358 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.857277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.860871 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.864113 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-199c2f90-c461-43e3-b629-ecd01e768662 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1750 microversion: 2.20 time: 0.222501 Oct 30 01:16:07.865256 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 325/659] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:07 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1750 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:08.913354 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:08.915788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:08.927665 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.928528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.929794 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.931121 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.932045 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.932765 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.045402 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:09.046276 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:09.056268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.057247 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.057733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.058875 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.059444 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.060130 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.103513 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-94cdf5de-35f6-4e0c-af37-3e03bfcfd79d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/ips" status: 200 len: 149 microversion: 2.1 time: 0.063453 Oct 30 01:16:09.104531 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 326/660] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:16:09 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/ips => generated 149 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:16:09.486604 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.502650 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.504469 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.505773 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-697c3a97-2585-42d1-b278-58324ff8c313 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.599908 Oct 30 01:16:09.506339 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 335/661] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:08 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:10.547138 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:10.547789 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:10.555065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:10.555549 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:10.556043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:10.569258 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:10.570759 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:10.571963 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:10.809026 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:10.820956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:10.823653 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:10.825760 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9050b2fa-bff8-45e3-aca7-443fd92e2ae9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.284667 Oct 30 01:16:10.834233 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 327/662] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:10 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:11.127355 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f8b3cac-6954-4959-bf54-aab6837968b6"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:11.131656 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:11.143233 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.145135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.146308 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.148511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.150593 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.151887 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.869815 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:11.871052 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:11.891980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.893200 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.894199 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.895758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.896837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.897873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.199714 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.217269 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.220152 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.222776 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-02d8d9a1-08b0-4533-8598-48ac60047dc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.360604 Oct 30 01:16:12.223814 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 328/663] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:11 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:13.091898 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=4 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:13.255571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:13.256971 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:13.269175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.269915 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.270502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.271469 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.272226 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.273331 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.548054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:13.560800 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:13.563159 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:13.564976 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b5cfcfbb-3a9d-4f05-945c-27d33c54c851 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.317633 Oct 30 01:16:13.565990 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 329/664] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:13 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:14.598348 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:14.601631 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:14.614347 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.615175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.615974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.617767 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.618552 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.619307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.847860 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.862798 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.862798 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.862798 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-96deb21f-cf62-43b2-9302-5516be3ce39e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.271359 Oct 30 01:16:14.863643 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 330/665] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:14 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:15.893417 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:15.894497 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:15.908981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.910427 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.911675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:15.915269 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.916084 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.916700 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.201491 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.215512 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.219417 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.222377 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e5d0b058-9a1e-4839-84d1-892ced99e66d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.336333 Oct 30 01:16:16.240020 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 331/666] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:15 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:17.274970 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:17.285439 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:17.285439 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:17.290250 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.291114 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.291966 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.293279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.294139 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.294924 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.334229 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:17.567992 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:17.576226 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:17.580651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:17.582399 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-475e9383-1c52-46ff-afc0-0c380c2bc29e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.316623 Oct 30 01:16:17.583078 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 332/667] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:17 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:18.630023 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:18.630023 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:18.636688 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.637290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.637908 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.638732 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.639246 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.639758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.809282 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:18.827867 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:18.829621 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:18.831098 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8b4f9961-cefc-4676-be5d-512ea87bea63 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.214005 Oct 30 01:16:18.842973 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 333/668] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:18 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:19.858110 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:19.858907 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:19.867533 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:19.868051 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:19.868484 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:19.869203 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:19.869663 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:19.870088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:20.055599 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.072394 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.076950 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.077482 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-06b63782-9f77-4669-87fb-cb24004e21d3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.223372 Oct 30 01:16:20.078484 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 334/669] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:19 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:21.115417 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.116829 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.123751 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.124246 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.124671 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.125381 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.125840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.126257 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.138348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:21.313207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:21.330317 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:21.333484 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:21.336099 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3e50c679-b056-4b8e-b29f-d597cc051c9d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.224840 Oct 30 01:16:21.337545 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 335/670] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:21.928828 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-338735c3-5437-4a22-9ec5-702a935af534 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.808531 Oct 30 01:16:21.929709 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 336/671] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:16:11 2022] POST /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments => generated 194 bytes in 10811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:22.214065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-446097009", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1317867039", "security_groups": [{"name": "tempest-secgroup-smoke-925082411"}], "networks": [{"uuid": "c4792b2f-e657-4c7b-b875-e1eadaeb2c7f"}], "block_device_mapping_v2": [{"uuid": "26c7a6bd-2669-4d2e-97a8-7a42b3de73bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:22.342604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] validate_networks() for [('c4792b2f-e657-4c7b-b875-e1eadaeb2c7f', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:22.376874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:22.377845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:22.385874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.386475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.386992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.387781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.388400 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.388838 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.607084 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:22.623475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:22.628510 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:22.630554 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a163a0ee-e20c-4ed9-8608-728b67d58001 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.258608 Oct 30 01:16:22.631300 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 337/672] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:22 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:22.943733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:22.944176 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:22.944678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:22.945082 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:22.945513 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:22.955669 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.956158 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.956591 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.957329 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.957782 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.958202 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.978461 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Getting quotas for project 55f0064a8bc14f30b2749047dfd2f53d. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:22.983274 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Getting quotas for user 4af60a16a7c24542b5b8aa94d2bfe9ef and project 55f0064a8bc14f30b2749047dfd2f53d. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:23.072364 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:23.077266 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26c7a6bd-2669-4d2e-97a8-7a42b3de73bd',volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:23.599235 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b3f1287f-166b-46e5-a96e-a118b355630a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.389956 Oct 30 01:16:23.608595 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 336/673] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:16:23.611829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d69dcbd8-7acb-4a20-a180-245bef44115c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:23.613198 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d69dcbd8-7acb-4a20-a180-245bef44115c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:23.673487 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:23.674102 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:23.678816 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d69dcbd8-7acb-4a20-a180-245bef44115c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.682331 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:23.682828 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:23.683454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:23.684354 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:23.684687 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:23.685097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:23.691488 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d69dcbd8-7acb-4a20-a180-245bef44115c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1088 microversion: 2.1 time: 0.083493 Oct 30 01:16:23.692125 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 338/674] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:23 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:23.864620 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.879841 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.883578 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.885889 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-41527646-5408-45e1-b729-f6d11ad7b94c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.216257 Oct 30 01:16:23.887137 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 337/675] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:23 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:24.284486 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8588b347-2c50-48e7-9331-a88c0c865dc2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: .version_select at 0x7f048c0b4dc0>, body: {"keypair": {"name": "tempest-keypair-1722104384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQsrFKQX4FqZ50vi7pM7I3/yBCByCOa4ZXIGnGCa4HpthoLAQMZAE1S+uGBBnTjBGIsGKIgY5YWm+yZzBm2AS7GESklr9GoJToAZR5j64ITIoAohvWaFvrQDuSm4joQVA=="}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:24.306158 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-8588b347-2c50-48e7-9331-a88c0c865dc2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:24.310921 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-8588b347-2c50-48e7-9331-a88c0c865dc2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:24.653922 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8588b347-2c50-48e7-9331-a88c0c865dc2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.376547 Oct 30 01:16:24.655074 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 339/676] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:16:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:16:24.715657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-12eb1911-116e-4cdb-8bb8-3a6a6942392b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:24.716482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-12eb1911-116e-4cdb-8bb8-3a6a6942392b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:24.779190 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-12eb1911-116e-4cdb-8bb8-3a6a6942392b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:24.786469 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-12eb1911-116e-4cdb-8bb8-3a6a6942392b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1088 microversion: 2.1 time: 0.074765 Oct 30 01:16:24.787051 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 338/677] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:24 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:24.925118 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:24.925704 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:24.932073 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:24.932575 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:24.933017 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:24.933715 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:24.934166 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:24.934588 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:25.141226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.141226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.141610 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.141610 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f5ae3703-bc03-4524-b258-b427bdfd77f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.177441 Oct 30 01:16:25.141610 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 340/678] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:24 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:25.424345 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-cc39993e-5835-4d0b-89fe-c4eca54930bc req-9d7f57b1-f9bf-4a41-872e-6ba0b9d32216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61f5ece-c472-4444-b1e0-365185ebf03f", "name": "network-vif-plugged", "status": "completed", "tag": "1d6fd425-3461-45ae-8efb-bc1ff24c309a"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:25.439852 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-cc39993e-5835-4d0b-89fe-c4eca54930bc req-9d7f57b1-f9bf-4a41-872e-6ba0b9d32216 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:25.440324 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-cc39993e-5835-4d0b-89fe-c4eca54930bc req-9d7f57b1-f9bf-4a41-872e-6ba0b9d32216 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:25.440757 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-cc39993e-5835-4d0b-89fe-c4eca54930bc req-9d7f57b1-f9bf-4a41-872e-6ba0b9d32216 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:25.453829 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-cc39993e-5835-4d0b-89fe-c4eca54930bc req-9d7f57b1-f9bf-4a41-872e-6ba0b9d32216 service nova] Creating event network-vif-plugged:1d6fd425-3461-45ae-8efb-bc1ff24c309a for instance a61f5ece-c472-4444-b1e0-365185ebf03f on hv-cinder-maste Oct 30 01:16:25.459707 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-cc39993e-5835-4d0b-89fe-c4eca54930bc req-9d7f57b1-f9bf-4a41-872e-6ba0b9d32216 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039950 Oct 30 01:16:25.460334 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 339/679] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:16:25.814710 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-930c89b3-9b02-41a9-8331-6d61d38891dd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:25.815790 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-930c89b3-9b02-41a9-8331-6d61d38891dd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:25.906151 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-930c89b3-9b02-41a9-8331-6d61d38891dd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.914019 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-930c89b3-9b02-41a9-8331-6d61d38891dd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1088 microversion: 2.1 time: 0.107239 Oct 30 01:16:25.919428 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 341/680] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:25 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1088 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:26.176018 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:26.176848 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:26.184989 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.185490 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.185930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.186646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.187117 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.187542 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.383164 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:26.400149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:26.403109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:26.405524 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-907294cd-9b2b-48d1-b2c6-a69524826872 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.234395 Oct 30 01:16:26.406566 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 340/681] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:26 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:26.937442 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:26.938117 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:26.946472 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.947025 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.947497 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.948286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.948780 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.949235 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.053716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.063963 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-02511972-a499-47f8-b9a3-fba404ced530 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1186 microversion: 2.1 time: 0.130819 Oct 30 01:16:27.064822 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 342/682] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:26 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1186 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:27.437658 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:27.438611 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:27.451135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.452039 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.452815 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.454078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.454935 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.455752 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.699509 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.710441 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.712447 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.713215 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9b520f1c-34bf-4da2-a6b4-570bf7fa903e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.283316 Oct 30 01:16:27.713782 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 341/683] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:27 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:28.094241 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:28.096486 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:28.109579 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.111034 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.112871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.114125 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.116827 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.117923 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.244536 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:28.263531 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-42e9e56a-03cd-46fb-b426-664857289de5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1194 microversion: 2.1 time: 0.177019 Oct 30 01:16:28.275069 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 343/684] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:28 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1194 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:28.411479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1283296458", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "843e4324-5c32-4e7f-add7-0c4eec3b7e77"}], "security_groups": [{"name": "tempest-securitygroup--497855437"}], "key_name": "tempest-keypair-1722104384", "user_data": "}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:28.575663 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.network.neutron [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] validate_networks() for [('843e4324-5c32-4e7f-add7-0c4eec3b7e77', None, None, None, None, None)] {{(pid=119523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:28.758949 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:28.759828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:28.767616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.773313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.773313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.773313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.773313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.773954 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.103261 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:29.142361 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:29.156967 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:29.159004 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c099b5eb-0a57-4d3b-ab2b-d2176aeaad9f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1806 microversion: 2.20 time: 0.406178 Oct 30 01:16:29.174963 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 344/685] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:28 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1806 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:29.290927 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:29.303676 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:29.303676 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.304529 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.305360 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.306813 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.307972 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.308754 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.364120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:29.364533 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image limits 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:29.365002 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:29.365500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image pref 0:0:0 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:29.365867 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.virt.hardware [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:29.376189 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.376679 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.377108 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.378140 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.378625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.379067 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.413574 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:29.422588 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:29.430230 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:29.439175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Going to run 1 instances... {{(pid=119523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:29.441633 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:29.445841 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-041f6361-e5be-4605-afbf-0e56ea00c1c6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1204 microversion: 2.1 time: 0.161043 Oct 30 01:16:29.446949 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 345/686] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:29 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1204 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:29.745693 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ea7198ca-cb7c-4628-bc64-62ae0e8868d3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.338235 Oct 30 01:16:29.749767 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 342/687] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:16:29.765874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-52b232e5-7e9d-4403-a713-1cb94b94c294 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:29.766552 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-52b232e5-7e9d-4403-a713-1cb94b94c294 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:29.837689 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-52b232e5-7e9d-4403-a713-1cb94b94c294 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:29.850549 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-52b232e5-7e9d-4403-a713-1cb94b94c294 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1242 microversion: 2.1 time: 0.087935 Oct 30 01:16:29.851567 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 346/688] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:29 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:30.205114 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:30.205828 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:30.213903 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.214399 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.214835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.215541 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.216036 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.216507 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.446545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.459412 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.460933 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.464941 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-561446cb-418a-4629-b1f0-6c047b666526 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1793 microversion: 2.20 time: 0.261347 Oct 30 01:16:30.464941 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 343/689] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:30 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1793 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:30.481534 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:30.482190 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:30.489919 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.491200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.491663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.492397 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.492918 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.493511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.895169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cc3183ea-d85c-4ae6-95a5-6d0f024ebd98 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:30.896157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-cc3183ea-d85c-4ae6-95a5-6d0f024ebd98 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:31.039906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cc3183ea-d85c-4ae6-95a5-6d0f024ebd98 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:31.047974 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-cc3183ea-d85c-4ae6-95a5-6d0f024ebd98 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1242 microversion: 2.1 time: 0.156846 Oct 30 01:16:31.051955 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 344/690] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:30 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1242 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:31.069047 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:31.078300 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8f2057cf-e77d-4bf7-a4ca-e33595f28312 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1259 microversion: 2.1 time: 0.601248 Oct 30 01:16:31.080634 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 347/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:30 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1259 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:31.451261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-7346cdb0-5e97-42e9-a494-ca97b5d25281 req-aa3d2be8-716d-4620-8331-b44ab0d81772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37986d61-58aa-43a7-95eb-99ab0e188914", "tag": "2787be5c-6341-4c37-abbb-ddd900bf4590"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:31.481055 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-7346cdb0-5e97-42e9-a494-ca97b5d25281 req-aa3d2be8-716d-4620-8331-b44ab0d81772 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:31.484817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-7346cdb0-5e97-42e9-a494-ca97b5d25281 req-aa3d2be8-716d-4620-8331-b44ab0d81772 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:31.496369 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-7346cdb0-5e97-42e9-a494-ca97b5d25281 req-aa3d2be8-716d-4620-8331-b44ab0d81772 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:31.503039 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-7346cdb0-5e97-42e9-a494-ca97b5d25281 req-aa3d2be8-716d-4620-8331-b44ab0d81772 service nova] Creating event network-changed:2787be5c-6341-4c37-abbb-ddd900bf4590 for instance 37986d61-58aa-43a7-95eb-99ab0e188914 on hv-cinder-maste Oct 30 01:16:31.509711 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-7346cdb0-5e97-42e9-a494-ca97b5d25281 req-aa3d2be8-716d-4620-8331-b44ab0d81772 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067524 Oct 30 01:16:31.510392 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 345/692] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:32.075162 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:32.076074 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:32.086124 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:32.086438 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:32.087383 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.088535 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:32.089362 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:32.090563 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.120196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:32.121045 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:32.128834 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:32.129572 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:32.130117 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.131545 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:32.132149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:32.132680 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.194771 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:32.209722 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1e2032bb-fcd0-4ea4-b4b3-df8690308e4a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1294 microversion: 2.1 time: 0.141402 Oct 30 01:16:32.210991 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 348/693] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:32 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:32.292823 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:32.305148 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-837e1f6d-6325-4efd-a3e4-da89652a538e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1259 microversion: 2.1 time: 0.189872 Oct 30 01:16:32.310896 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 346/694] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:32 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:33.234175 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:33.234779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:33.242523 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.243128 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.243663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.244450 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.244959 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.245442 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.248799 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:33.323931 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:33.330345 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:33.331652 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:33.338925 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e78f962a-eb63-4003-b1e2-bdf9d0b6f33a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1312 microversion: 2.1 time: 0.108657 Oct 30 01:16:33.339451 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.339708 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 349/695] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:33 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:33.340337 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.340968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.341891 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.342596 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.343188 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.489884 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:33.500585 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c52a46bd-c62a-49a8-aea2-37b1e76a2e2e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1259 microversion: 2.1 time: 0.173983 Oct 30 01:16:33.501185 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 347/696] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:33 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:34.374263 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:34.375099 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:34.382801 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.383301 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.383776 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.384494 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.384960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.385379 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.524401 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:34.525061 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:34.532116 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.532918 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.533577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.534776 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.535379 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.536046 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.578786 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:34.588080 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d189bd5e-ba63-4896-a3c1-e08361e9829d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.218044 Oct 30 01:16:34.589344 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 350/697] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:34 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:34.753825 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:34.765819 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-76aa105d-43ed-40a2-947a-9b4b4147067a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1259 microversion: 2.1 time: 0.245488 Oct 30 01:16:34.780089 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 348/698] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:34 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:35.618374 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:35.619424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:35.632841 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-21ce6791-1f42-40f0-acd6-7801e6a05716 req-68706664-e80e-467f-86de-c39065cb11c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b158f22f-4875-4dd7-9079-58e4dc91e7a3", "tag": "d5220d8d-5cb1-4fc2-a4fa-546aef839dac"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:35.644424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:35.645281 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:35.647907 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:35.649548 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:35.650710 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:35.651434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:35.651636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-21ce6791-1f42-40f0-acd6-7801e6a05716 req-68706664-e80e-467f-86de-c39065cb11c5 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:35.656710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-21ce6791-1f42-40f0-acd6-7801e6a05716 req-68706664-e80e-467f-86de-c39065cb11c5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:35.656710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-21ce6791-1f42-40f0-acd6-7801e6a05716 req-68706664-e80e-467f-86de-c39065cb11c5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:35.685112 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-21ce6791-1f42-40f0-acd6-7801e6a05716 req-68706664-e80e-467f-86de-c39065cb11c5 service nova] Creating event network-changed:d5220d8d-5cb1-4fc2-a4fa-546aef839dac for instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 on hv-cinder-maste Oct 30 01:16:35.695207 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-21ce6791-1f42-40f0-acd6-7801e6a05716 req-68706664-e80e-467f-86de-c39065cb11c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068696 Oct 30 01:16:35.696853 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 349/699] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:16:35.793520 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:35.794482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:35.804037 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:35.804736 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:35.805290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:35.806130 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:35.806730 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:35.807247 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:35.978909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:35.995659 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-701627ff-9520-49e3-be9b-23d22c1abbd1 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.384546 Oct 30 01:16:36.007724 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 351/700] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:35 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:36.079172 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:36.088392 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-49a54fd1-4eb9-46c9-b155-1416144f6538 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1259 microversion: 2.1 time: 0.301232 Oct 30 01:16:36.088991 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 350/701] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:35 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1259 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:37.020406 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:37.021009 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:37.028803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.029639 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.030224 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.031024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.031516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.032015 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.114502 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:37.115091 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:37.122925 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.123414 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.123870 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.124566 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.125009 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.125424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.179979 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:37.188257 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-74aa29fd-b010-40e7-8d43-84125c611eb7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.171628 Oct 30 01:16:37.188855 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 352/702] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:37 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:37.284931 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:37.294045 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-221f4795-7bf8-4ec7-9a1c-43e35dfc4a9a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1259 microversion: 2.1 time: 0.183888 Oct 30 01:16:37.294635 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 351/703] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:37 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:37.543083 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-ea1870dc-25c8-4158-b4f7-00a830499609 req-d1081d03-db68-46ec-a663-6eb2219af089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37986d61-58aa-43a7-95eb-99ab0e188914", "name": "network-vif-plugged", "status": "completed", "tag": "2787be5c-6341-4c37-abbb-ddd900bf4590"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:37.553290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-ea1870dc-25c8-4158-b4f7-00a830499609 req-d1081d03-db68-46ec-a663-6eb2219af089 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.553778 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-ea1870dc-25c8-4158-b4f7-00a830499609 req-d1081d03-db68-46ec-a663-6eb2219af089 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.554238 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-ea1870dc-25c8-4158-b4f7-00a830499609 req-d1081d03-db68-46ec-a663-6eb2219af089 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.566755 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-ea1870dc-25c8-4158-b4f7-00a830499609 req-d1081d03-db68-46ec-a663-6eb2219af089 service nova] Creating event network-vif-plugged:2787be5c-6341-4c37-abbb-ddd900bf4590 for instance 37986d61-58aa-43a7-95eb-99ab0e188914 on hv-cinder-maste Oct 30 01:16:37.572895 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-ea1870dc-25c8-4158-b4f7-00a830499609 req-d1081d03-db68-46ec-a663-6eb2219af089 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Oct 30 01:16:37.573510 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 353/704] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:38.212930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:38.213552 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:38.220262 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.220734 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.221157 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.221851 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.222295 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.222711 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.321725 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:38.322384 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:38.329133 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.329638 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.330074 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.330784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.331298 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.331700 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.387003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:38.396172 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c703eeb0-2e3e-4350-8790-d04e958970e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.187027 Oct 30 01:16:38.396777 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 352/705] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:38 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:38.481400 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:38.494644 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3a391a50-4e18-4519-83d9-557071ce704a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1259 microversion: 2.1 time: 0.178152 Oct 30 01:16:38.495555 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 354/706] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:38 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:39.419125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:39.420219 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:39.423165 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=4 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:39.431255 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.432035 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.432591 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.433638 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.434270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.434823 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.518912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:39.519533 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:39.527355 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.528111 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.528836 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.529684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.530319 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.530846 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.636763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:39.652767 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e07ebdfa-e30d-4f98-b227-28ba1e4d0c60 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.237189 Oct 30 01:16:39.654230 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 353/707] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:39 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:39.740917 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:39.749234 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0485f307-88c4-4b99-83e9-6748804def0f tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1442 microversion: 2.1 time: 0.234367 Oct 30 01:16:39.749826 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 355/708] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:39 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1442 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:39.774842 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:39.775514 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:39.782685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.783225 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.783829 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.784582 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.785088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.785651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.801771 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:39.948873 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:39.959730 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-baa638b1-2a6e-4e0d-80d6-f01b76e753a6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1442 microversion: 2.1 time: 0.189482 Oct 30 01:16:39.975696 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 354/709] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:39 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1442 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:40.690552 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:40.691492 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:40.695925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=10 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:40.701191 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.702307 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.702307 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:40.703454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.704296 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.704905 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:40.890205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:40.900173 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e6bb3689-4677-4058-85b6-ddca77b8650d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.213477 Oct 30 01:16:40.900910 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 356/710] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:40 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:41.602374 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-2a24103f-ee25-43d3-b78c-fbebec3a7dd1 req-dd725189-2351-4c15-84e6-2b8edaac092b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b158f22f-4875-4dd7-9079-58e4dc91e7a3", "name": "network-vif-plugged", "status": "completed", "tag": "d5220d8d-5cb1-4fc2-a4fa-546aef839dac"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:41.609505 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=16 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:41.616604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-2a24103f-ee25-43d3-b78c-fbebec3a7dd1 req-dd725189-2351-4c15-84e6-2b8edaac092b service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:41.617181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-2a24103f-ee25-43d3-b78c-fbebec3a7dd1 req-dd725189-2351-4c15-84e6-2b8edaac092b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:41.617688 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-2a24103f-ee25-43d3-b78c-fbebec3a7dd1 req-dd725189-2351-4c15-84e6-2b8edaac092b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:41.632124 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-2a24103f-ee25-43d3-b78c-fbebec3a7dd1 req-dd725189-2351-4c15-84e6-2b8edaac092b service nova] Creating event network-vif-plugged:d5220d8d-5cb1-4fc2-a4fa-546aef839dac for instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 on hv-cinder-maste Oct 30 01:16:41.637180 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-2a24103f-ee25-43d3-b78c-fbebec3a7dd1 req-dd725189-2351-4c15-84e6-2b8edaac092b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039596 Oct 30 01:16:41.638040 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 355/711] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:41.926762 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:41.927792 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:41.936406 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:41.937113 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:41.937774 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:41.938638 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:41.939236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:41.939874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.154104 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:42.168922 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8117d008-c0fb-498c-b388-c9f440645533 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.246551 Oct 30 01:16:42.169986 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 357/712] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:41 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:42.574116 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-0b234b57-cca9-4169-90e5-3fbb1695ca8e req-4c8392e6-50c2-49fd-b5f1-0c9a6d38e938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37986d61-58aa-43a7-95eb-99ab0e188914", "tag": "2787be5c-6341-4c37-abbb-ddd900bf4590"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:42.593588 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-0b234b57-cca9-4169-90e5-3fbb1695ca8e req-4c8392e6-50c2-49fd-b5f1-0c9a6d38e938 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.594456 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-0b234b57-cca9-4169-90e5-3fbb1695ca8e req-4c8392e6-50c2-49fd-b5f1-0c9a6d38e938 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.595231 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-0b234b57-cca9-4169-90e5-3fbb1695ca8e req-4c8392e6-50c2-49fd-b5f1-0c9a6d38e938 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.611070 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-0b234b57-cca9-4169-90e5-3fbb1695ca8e req-4c8392e6-50c2-49fd-b5f1-0c9a6d38e938 service nova] Creating event network-changed:2787be5c-6341-4c37-abbb-ddd900bf4590 for instance 37986d61-58aa-43a7-95eb-99ab0e188914 on hv-cinder-maste Oct 30 01:16:42.617255 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-0b234b57-cca9-4169-90e5-3fbb1695ca8e req-4c8392e6-50c2-49fd-b5f1-0c9a6d38e938 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051858 Oct 30 01:16:42.617885 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 356/713] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:16:43.202053 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:43.203149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:43.213277 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:43.213781 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:43.214441 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:43.215528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:43.216406 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:43.217171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:43.430766 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:43.445980 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e839987c-3c39-4349-bc17-0ccc24059dbd tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1367 microversion: 2.1 time: 0.250493 Oct 30 01:16:43.447041 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 358/714] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:43 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:44.485388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:44.486152 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:44.493137 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.493676 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.494309 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.495176 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.495745 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.496212 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.704071 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:44.713514 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-70697642-db83-4e11-b668-c8a2ab50eccf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1557 microversion: 2.1 time: 0.233342 Oct 30 01:16:44.714533 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 357/715] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:44 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:44.738435 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:44.739027 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:44.745985 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.746493 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.746928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.747684 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.748148 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.748576 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.869429 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-306d6a38-8400-4d04-8193-117d6629b530 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134894 Oct 30 01:16:44.870548 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 359/716] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:16:44 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:46.029500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-e50f5238-e233-420f-9394-d0a854c78429 req-4144a9b5-2873-44c1-b030-223848b480ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b158f22f-4875-4dd7-9079-58e4dc91e7a3", "tag": "d5220d8d-5cb1-4fc2-a4fa-546aef839dac"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:46.042051 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-e50f5238-e233-420f-9394-d0a854c78429 req-4144a9b5-2873-44c1-b030-223848b480ca service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.042767 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-e50f5238-e233-420f-9394-d0a854c78429 req-4144a9b5-2873-44c1-b030-223848b480ca service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.044186 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-e50f5238-e233-420f-9394-d0a854c78429 req-4144a9b5-2873-44c1-b030-223848b480ca service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.056488 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-e50f5238-e233-420f-9394-d0a854c78429 req-4144a9b5-2873-44c1-b030-223848b480ca service nova] Creating event network-changed:d5220d8d-5cb1-4fc2-a4fa-546aef839dac for instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 on hv-cinder-maste Oct 30 01:16:46.062203 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-e50f5238-e233-420f-9394-d0a854c78429 req-4144a9b5-2873-44c1-b030-223848b480ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 Oct 30 01:16:46.062828 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 358/717] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:03.467547 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:03.468355 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=59 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:03.472732 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:03.473227 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:03.480022 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.481090 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.481090 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.481659 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.482120 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.482551 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.518917 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-bea8f3ba-697d-4d9f-ad57-2097b33190cf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments/1e710b03-6a9f-42b9-93e2-55f9309a4e2a" status: 200 len: 194 microversion: 2.20 time: 0.052751 Oct 30 01:17:03.519768 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 360/718] 10.222.0.26 () {60 vars in 1454 bytes} [Sun Oct 30 01:17:03 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments/1e710b03-6a9f-42b9-93e2-55f9309a4e2a => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:17:03.594108 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:03.594883 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=15 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:03.599415 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:03.600081 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:03.610274 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.611203 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.612058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.613444 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.614708 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.615483 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.733458 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lazy-loading 'services' on Instance uuid a61f5ece-c472-4444-b1e0-365185ebf03f {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:04.090745 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-68309779-05ce-4fac-a6d7-d68ba34bfab4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments/1e710b03-6a9f-42b9-93e2-55f9309a4e2a" status: 202 len: 0 microversion: 2.20 time: 0.498457 Oct 30 01:17:04.091359 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 359/719] 10.222.0.26 () {60 vars in 1457 bytes} [Sun Oct 30 01:17:03 2022] DELETE /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments/1e710b03-6a9f-42b9-93e2-55f9309a4e2a => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:04.101378 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:04.103933 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:04.111625 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.112194 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.112612 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.113348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.114421 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.114852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.149192 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5f5962c6-f817-4a88-b3ef-845b99bcac75 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053051 Oct 30 01:17:04.149789 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 361/720] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Oct 30 01:17:04 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:17:05.165558 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:05.168191 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.175213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.175733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.176169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.176870 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.177323 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.177804 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.212182 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-72c38179-09b0-4d27-9dc7-12b9438aa587 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052812 Oct 30 01:17:05.212716 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 360/721] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Oct 30 01:17:05 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:17:06.226300 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.228673 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.235361 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.235876 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.236306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.237012 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.237522 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.237924 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.270687 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-abf60ab4-3e63-43e0-99a6-cb785bb31c8b tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049531 Oct 30 01:17:06.271278 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 362/722] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:06.340709 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.341559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.348888 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.349433 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.349933 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.350697 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.351196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.351710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.380175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:06.743224 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-db1156c6-3fc6-4621-b876-5f1685547cc7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 204 len: 0 microversion: 2.20 time: 0.406428 Oct 30 01:17:06.743957 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 361/723] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 30 01:17:06 2022] DELETE /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:17:06.752701 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.753311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.759766 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.760264 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.760695 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.761412 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.761867 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.762296 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.931186 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:06.940065 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:06.941541 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:06.943291 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1deb32fa-21eb-4c67-b79d-1d37db68bede tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.194790 Oct 30 01:17:06.943889 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 363/724] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:07.970668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:07.971323 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:07.978362 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.978901 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.979365 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.980125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.980587 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.981012 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:08.134170 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:08.143370 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:08.145042 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:08.146328 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-eca11a25-290d-4cda-8db5-46ba2401394e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.180334 Oct 30 01:17:08.146980 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 362/725] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:07 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:09.174013 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:09.174864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:09.183558 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.184182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.184746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.185652 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.186256 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.186779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.900024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:09.908838 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:09.910396 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:09.911678 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c835dd26-a500-4602-8797-b8dcc4ff30fe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1721 microversion: 2.20 time: 0.742236 Oct 30 01:17:09.916046 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 364/726] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:09 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1721 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:10.469529 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-4d90d699-6e25-4273-8ca6-0e0aeb3178df req-3c838268-73d8-4dd7-8fdb-f58c0fad05cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61f5ece-c472-4444-b1e0-365185ebf03f", "name": "network-vif-deleted", "tag": "1d6fd425-3461-45ae-8efb-bc1ff24c309a"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:10.497518 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-4d90d699-6e25-4273-8ca6-0e0aeb3178df req-3c838268-73d8-4dd7-8fdb-f58c0fad05cd service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.498288 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-4d90d699-6e25-4273-8ca6-0e0aeb3178df req-3c838268-73d8-4dd7-8fdb-f58c0fad05cd service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.498905 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-4d90d699-6e25-4273-8ca6-0e0aeb3178df req-3c838268-73d8-4dd7-8fdb-f58c0fad05cd service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.522789 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-4d90d699-6e25-4273-8ca6-0e0aeb3178df req-3c838268-73d8-4dd7-8fdb-f58c0fad05cd service nova] Creating event network-vif-deleted:1d6fd425-3461-45ae-8efb-bc1ff24c309a for instance a61f5ece-c472-4444-b1e0-365185ebf03f on hv-cinder-maste Oct 30 01:17:10.529100 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-4d90d699-6e25-4273-8ca6-0e0aeb3178df req-3c838268-73d8-4dd7-8fdb-f58c0fad05cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065774 Oct 30 01:17:10.530159 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 363/727] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:17:10.943240 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:10.944432 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:10.955665 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.956475 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.958521 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.958979 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.959841 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.960561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.010844 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.011737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.012571 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.013401 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lazy-loading 'fault' on Instance uuid a61f5ece-c472-4444-b1e0-365185ebf03f {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:11.076622 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:11.096351 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:11.100390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:11.102785 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3f70d710-84a8-403f-9349-7a7d9fc3b102 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 200 len: 1369 microversion: 2.20 time: 0.167143 Oct 30 01:17:11.105786 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 365/728] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:10 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:12.143717 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:12.144586 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:12.151704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.152196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.152634 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.153371 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.153825 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.154251 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.170522 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] HTTP exception thrown: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Request method failure captured: Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f HTTP/1.1 Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc_kehOblZqvIoG-5aCfyhObHgPDaT6KnVgebMI1gVHHy2WnHUqxP_G8Rq9QDfl0HMkQVNU0fy2eBa2JKpvj7Zd-zrR_yuNvy0TdP4k45hiR0CsfcPjsv43fr1zoXU_zHCFBXEdOLUTb-KZ31Z2zIkIGwljp0OjhpvCn32cDKfoLK2g Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:17:12.172307 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e74d6179e574138841007195fd72400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e74d6179e574138841007195fd72400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 1d21128dee354a04bfb008efe6b60899 Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:17:12.174438 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'a61f5ece-c472-4444-b1e0-365185ebf03f'} Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:12.175851 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:17:12.178874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:12.180844 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Returning 404 to user: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:12.180844 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f7b1ce0b-1f99-4099-8a23-e4299837af6e tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 404 len: 111 microversion: 2.20 time: 0.035141 Oct 30 01:17:12.180844 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 364/729] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:12 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:17:12.185824 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-98f2c016-39dc-4d50-ac33-351524041079 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '.version_select at 0x7f0487efee50>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:12.276304 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-98f2c016-39dc-4d50-ac33-351524041079 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92011683" status: 204 len: 0 microversion: 2.20 time: 0.094494 Oct 30 01:17:12.277067 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 366/730] 10.222.0.26 () {60 vars in 1256 bytes} [Sun Oct 30 01:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92011683 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:17:13.241071 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8b1de071-d4ee-4dcc-88f0-16bd84a9895a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'create', calling method: .version_select at 0x7f0487cdc0d0>, body: {"keypair": {"name": "tempest-keypair-1984760449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATe+Vze/yzMK2f9kZGc9986hh9YtI2R5EB1l55b4C/nQSS1ZKJxGBbFx6pa638hGa6tMIeHXEgei5bl75lV78F7IP5S+Ma3zRDlRWn4lwCbat48zRn5hq82GxbH6WhL8g=="}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:13.259279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-8b1de071-d4ee-4dcc-88f0-16bd84a9895a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for project 6e74d6179e574138841007195fd72400. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:13.264433 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-8b1de071-d4ee-4dcc-88f0-16bd84a9895a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for user 1d21128dee354a04bfb008efe6b60899 and project 6e74d6179e574138841007195fd72400. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:13.373941 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8b1de071-d4ee-4dcc-88f0-16bd84a9895a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.136860 Oct 30 01:17:13.374716 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 365/731] 10.222.0.26 () {62 vars in 1200 bytes} [Sun Oct 30 01:17:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:17:16.263132 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1022848765", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6257f567-c00a-4953-abb1-a059fb358974"}], "security_groups": [{"name": "tempest-securitygroup--1669636412"}], "key_name": "tempest-keypair-1984760449", "user_data": "}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:16.386270 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] validate_networks() for [('6257f567-c00a-4953-abb1-a059fb358974', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:17:16.814957 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:16.815526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:16.816704 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:16.817227 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:16.817852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:16.830496 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.831834 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.833413 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.834798 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.835511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.836034 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.860122 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for project 6e74d6179e574138841007195fd72400. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:16.865774 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Getting quotas for user 1d21128dee354a04bfb008efe6b60899 and project 6e74d6179e574138841007195fd72400. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:16.882559 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:17:16.885827 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:17:17.018597 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ae5a3843-37bc-43bb-8051-aaeccbefedfe tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.760705 Oct 30 01:17:17.019294 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 367/732] 10.222.0.26 () {62 vars in 1188 bytes} [Sun Oct 30 01:17:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 30 01:17:17.031503 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eecfabec-2942-4409-9a6e-dea8fb1d7c85 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:17.032455 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-eecfabec-2942-4409-9a6e-dea8fb1d7c85 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:17.096065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eecfabec-2942-4409-9a6e-dea8fb1d7c85 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.109734 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eecfabec-2942-4409-9a6e-dea8fb1d7c85 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.112640 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eecfabec-2942-4409-9a6e-dea8fb1d7c85 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.116016 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-eecfabec-2942-4409-9a6e-dea8fb1d7c85 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1282 microversion: 2.20 time: 0.088106 Oct 30 01:17:17.117007 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 366/733] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:17 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:18.154150 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:18.154801 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:18.161590 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.162088 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.162531 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.163259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.163772 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.164201 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.234463 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.246345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.247846 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.249092 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7c478414-2e37-4e4c-822c-5e908d8dc41c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1286 microversion: 2.20 time: 0.099531 Oct 30 01:17:18.249662 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 368/734] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:18 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:19.275753 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:19.276495 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:19.284248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.284827 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.285908 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.286704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.287203 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.287720 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.363888 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:19.379738 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:19.382681 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:19.384799 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6cdbd6d3-6c94-4bc1-a457-488a11feff14 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1334 microversion: 2.20 time: 0.112789 Oct 30 01:17:19.385802 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 367/735] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:19 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:20.429830 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:20.431300 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:20.440845 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.441487 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.442206 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.443060 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.443744 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.444293 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.566745 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.577704 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.579464 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.580755 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-afc3837f-1966-4866-8447-c95f7e24a284 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1340 microversion: 2.20 time: 0.157179 Oct 30 01:17:20.581336 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 369/736] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:20 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1340 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:17:21.609768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:21.610508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:21.617626 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.618113 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.618544 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.619321 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.619816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.620249 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.837872 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.852962 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.855202 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.856890 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2ab10f85-a698-4c6c-8d9c-b6d52fb6de01 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1408 microversion: 2.20 time: 0.251484 Oct 30 01:17:21.859662 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 368/737] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:21 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:22.246347 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-24ea8922-225c-44cb-ad03-209a9eae4fa6 req-0a1559af-f784-44a1-a698-32cd12e73cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4daf78ff-76d5-4869-a92a-e0b67f4721b3", "tag": "048da4f3-1d63-47ae-b4af-333cac47dd73"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:22.266934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-24ea8922-225c-44cb-ad03-209a9eae4fa6 req-0a1559af-f784-44a1-a698-32cd12e73cf4 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.267852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-24ea8922-225c-44cb-ad03-209a9eae4fa6 req-0a1559af-f784-44a1-a698-32cd12e73cf4 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.268412 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-24ea8922-225c-44cb-ad03-209a9eae4fa6 req-0a1559af-f784-44a1-a698-32cd12e73cf4 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.291411 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-24ea8922-225c-44cb-ad03-209a9eae4fa6 req-0a1559af-f784-44a1-a698-32cd12e73cf4 service nova] Creating event network-changed:048da4f3-1d63-47ae-b4af-333cac47dd73 for instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 on hv-cinder-maste Oct 30 01:17:22.301202 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-24ea8922-225c-44cb-ad03-209a9eae4fa6 req-0a1559af-f784-44a1-a698-32cd12e73cf4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062580 Oct 30 01:17:22.305378 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 370/738] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:22.368415 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.369506 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.385735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.385735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.385735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.385735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.386738 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.387145 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.431721 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-20185261-2c07-4280-84e3-71a79cbc618a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3/ips" status: 200 len: 150 microversion: 2.1 time: 0.065676 Oct 30 01:17:22.431721 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 369/739] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3/ips => generated 150 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:22.441863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f8b3cac-6954-4959-bf54-aab6837968b6"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:22.444997 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.451755 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.452259 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.452718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.453429 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.453892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.454333 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.575499 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Invalid volume: volume 8f8b3cac-6954-4959-bf54-aab6837968b6 is already attached to instances: bc02e945-abfb-4689-b7b1-753df25b5f53 Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: POST /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3/os-volume_attachments HTTP/1.1 Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 74 Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:17:22.577624 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: {"volumeAttachment": {"volumeId": "8f8b3cac-6954-4959-bf54-aab6837968b6"}} Oct 30 01:17:22.579512 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Invalid volume: volume 8f8b3cac-6954-4959-bf54-aab6837968b6 is already attached to instances: bc02e945-abfb-4689-b7b1-753df25b5f53 Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'server_id': 'b158f22f-4875-4dd7-9079-58e4dc91e7a3', 'body': {'volumeAttachment': {'volumeId': '8f8b3cac-6954-4959-bf54-aab6837968b6'}}} Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8f8b3cac-6954-4959-bf54-aab6837968b6 is already attached to instances: bc02e945-abfb-4689-b7b1-753df25b5f53 Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.580837 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8f8b3cac-6954-4959-bf54-aab6837968b6 is already attached to instances: bc02e945-abfb-4689-b7b1-753df25b5f53 Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:22.582946 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8f8b3cac-6954-4959-bf54-aab6837968b6 is already attached to instances: bc02e945-abfb-4689-b7b1-753df25b5f53 Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 400 to user: Invalid volume: volume 8f8b3cac-6954-4959-bf54-aab6837968b6 is already attached to instances: bc02e945-abfb-4689-b7b1-753df25b5f53 {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c3c64463-6576-49b8-b299-1dd8860b57a4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143104 Oct 30 01:17:22.585540 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 371/740] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:17:22 2022] POST /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:17:22.588583 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.589081 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.595615 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.596065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.596557 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.597313 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.597781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.598202 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.628158 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:22.896607 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.897905 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.908623 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.909498 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.910264 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.911406 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.912286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.913042 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.965989 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0a56e4e0-bd59-4780-a292-adc98f4b1be5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 204 len: 0 microversion: 2.1 time: 0.380920 Oct 30 01:17:22.966781 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 370/741] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:17:22 2022] DELETE /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:22.977065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.978286 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.985616 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.986109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.986598 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.987553 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.988570 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.989004 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.228016 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.237024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.239036 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.240214 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f64e3540-41f0-48e3-8a81-d39d5efffc10 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1408 microversion: 2.20 time: 0.357916 Oct 30 01:17:23.241025 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 372/742] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:17:23.249022 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.263318 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-eac411bd-36af-42c0-8a7d-56da5ad8beac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1682 microversion: 2.1 time: 0.290864 Oct 30 01:17:23.263960 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 371/743] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:24.266758 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:24.267477 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:24.275865 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.276546 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.276988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.277716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.278149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.278575 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.289277 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:24.290025 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:24.305748 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.305748 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.305748 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.307287 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.308184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.308795 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.544275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:24.553945 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:24.554938 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:24.555459 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:24.556679 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-dbc2be08-18e1-4ba7-8d31-b1bb8294cedc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1408 microversion: 2.20 time: 0.294484 Oct 30 01:17:24.557253 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 373/744] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:24 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:24.569936 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-74cf3a4f-9614-4afc-b2f0-7507ae33a703 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1682 microversion: 2.1 time: 0.285771 Oct 30 01:17:24.570989 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 372/745] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:24 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1682 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:25.595281 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:25.596414 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:25.601013 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:25.602213 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:25.606268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.606771 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.607207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.608224 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.608687 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.614957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.617594 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.618136 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.618628 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.619409 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.619904 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.620335 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.029254 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:26.038846 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:26.040343 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:26.041499 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3b83b267-0a80-4ee1-993f-370c98bfc462 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1408 microversion: 2.20 time: 0.463088 Oct 30 01:17:26.042151 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 374/746] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:25 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:26.047002 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:26.065163 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1101e56d-e2e8-4f5d-a75e-89df42213184 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1682 microversion: 2.1 time: 0.473489 Oct 30 01:17:26.069928 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 373/747] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:25 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1682 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:27.002294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-2feaaa57-d4d3-45ed-b96a-abed633f995e req-14d9f765-3ccd-4e43-afd3-98c1340f439b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b158f22f-4875-4dd7-9079-58e4dc91e7a3", "name": "network-vif-deleted", "tag": "d5220d8d-5cb1-4fc2-a4fa-546aef839dac"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:27.009867 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:27.021519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=6 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:27.021519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-2feaaa57-d4d3-45ed-b96a-abed633f995e req-14d9f765-3ccd-4e43-afd3-98c1340f439b service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.021519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-2feaaa57-d4d3-45ed-b96a-abed633f995e req-14d9f765-3ccd-4e43-afd3-98c1340f439b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.021519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-2feaaa57-d4d3-45ed-b96a-abed633f995e req-14d9f765-3ccd-4e43-afd3-98c1340f439b service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.033309 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-2feaaa57-d4d3-45ed-b96a-abed633f995e req-14d9f765-3ccd-4e43-afd3-98c1340f439b service nova] Creating event network-vif-deleted:d5220d8d-5cb1-4fc2-a4fa-546aef839dac for instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 on hv-cinder-maste Oct 30 01:17:27.041415 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-2feaaa57-d4d3-45ed-b96a-abed633f995e req-14d9f765-3ccd-4e43-afd3-98c1340f439b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042227 Oct 30 01:17:27.043238 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 375/748] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:27.080746 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:27.081633 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:27.088240 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.090453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.090453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.090453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.090928 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.091149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.109340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:27.110609 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:27.112587 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:27.126801 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.127762 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.128674 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.130058 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.131216 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.132306 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.260316 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.273662 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2b010a5c-c3e2-4136-9c06-031e87775f30 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1615 microversion: 2.1 time: 0.171462 Oct 30 01:17:27.295237 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 376/749] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:27 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1615 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:27.325047 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.341711 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.344856 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.347114 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ecfd8064-42f0-487e-9799-6360aa3e3865 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1408 microversion: 2.20 time: 0.270436 Oct 30 01:17:27.348225 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 374/750] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:27 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:27.870358 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-87e09cc7-c701-4872-8ce5-f927ca396242 req-927cd8eb-d471-475f-9d7a-da314976a5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daf78ff-76d5-4869-a92a-e0b67f4721b3", "name": "network-vif-plugged", "status": "completed", "tag": "048da4f3-1d63-47ae-b4af-333cac47dd73"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:27.883252 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-87e09cc7-c701-4872-8ce5-f927ca396242 req-927cd8eb-d471-475f-9d7a-da314976a5fa service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.883928 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-87e09cc7-c701-4872-8ce5-f927ca396242 req-927cd8eb-d471-475f-9d7a-da314976a5fa service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.884553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-87e09cc7-c701-4872-8ce5-f927ca396242 req-927cd8eb-d471-475f-9d7a-da314976a5fa service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.905317 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-87e09cc7-c701-4872-8ce5-f927ca396242 req-927cd8eb-d471-475f-9d7a-da314976a5fa service nova] Creating event network-vif-plugged:048da4f3-1d63-47ae-b4af-333cac47dd73 for instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 on hv-cinder-maste Oct 30 01:17:27.911954 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-87e09cc7-c701-4872-8ce5-f927ca396242 req-927cd8eb-d471-475f-9d7a-da314976a5fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046793 Oct 30 01:17:27.912832 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 377/751] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:17:28.313596 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:28.314755 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:28.329609 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.330187 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.330704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.332321 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.333245 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.333768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.340183 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:28.392191 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.392466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.393173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.394339 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lazy-loading 'fault' on Instance uuid b158f22f-4875-4dd7-9079-58e4dc91e7a3 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:28.401100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:28.402555 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:28.417953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.417953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.418295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.418907 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.419420 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.419872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.467879 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:28.477110 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9c4d8677-52b3-4595-abc3-b2342327139e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 200 len: 1332 microversion: 2.1 time: 0.172456 Oct 30 01:17:28.478848 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 375/752] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:28 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:28.600148 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:28.609462 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:28.613803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:28.613803 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8b7491bf-4d18-41cf-ac8e-035b6c7b2ca0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1408 microversion: 2.20 time: 0.228005 Oct 30 01:17:28.613803 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 378/753] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:28 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:17:29.516625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:29.517300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:29.526436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.527340 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.527816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.528570 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.529025 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.529451 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.546227 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 HTTP/1.1 Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:17:29.548032 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:17:29.551613 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'b158f22f-4875-4dd7-9079-58e4dc91e7a3'} Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:29.553195 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:17:29.555694 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:29.558343 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:29.558343 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-92b46be1-2023-4233-bf81-11c16601a6ad tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 404 len: 111 microversion: 2.1 time: 0.037492 Oct 30 01:17:29.558343 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 376/754] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:29 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:17:29.565871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-023c78ab-1749-4af5-b746-8e6008291c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '.version_select at 0x7f0487dc1550>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:29.638298 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:29.639087 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:29.646508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.646996 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.647425 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.648175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.648625 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.649067 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.699906 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-023c78ab-1749-4af5-b746-8e6008291c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722104384" status: 202 len: 0 microversion: 2.1 time: 0.140275 Oct 30 01:17:29.700937 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 379/755] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 30 01:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722104384 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:17:29.857547 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:29.874096 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:29.877423 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:29.879714 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b9b013c3-b5c1-4c3e-88a4-5bf7fa5a595a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1408 microversion: 2.20 time: 0.245121 Oct 30 01:17:29.881125 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 377/756] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:29 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:17:30.836519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:30.837425 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:30.848058 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.848690 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.849179 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.850096 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.850552 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.850997 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.922184 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:30.923103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:30.930541 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.931045 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.931483 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.932254 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.932730 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.933149 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.949735 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=100 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:30.957489 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lazy-loading 'services' on Instance uuid bc02e945-abfb-4689-b7b1-753df25b5f53 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:31.280183 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:31.289578 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:31.291065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:31.292342 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-6b4960d5-5f67-4e6a-bf3d-71842beeb824 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1599 microversion: 2.20 time: 0.374233 Oct 30 01:17:31.292908 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 378/757] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:30 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1599 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:17:31.317074 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:31.323317 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:31.323529 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f4fc15b1-6d35-43ee-983d-69b0e645c6d0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments/8f8b3cac-6954-4959-bf54-aab6837968b6" status: 202 len: 0 microversion: 2.1 time: 0.490191 Oct 30 01:17:31.323529 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 380/758] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:17:30 2022] DELETE /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments/8f8b3cac-6954-4959-bf54-aab6837968b6 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:17:31.324395 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.324906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.325324 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.326307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.326944 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.327366 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.338058 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:31.342380 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:31.353181 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.355864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.355864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.356309 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.356885 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.357892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.414662 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-72299430-87f5-4cf5-a64d-c7e2f5a44c0f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085294 Oct 30 01:17:31.415284 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 381/759] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:31 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:31.426258 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f111eadd-e55f-4c4d-a9eb-349d97cd2d6f tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113074 Oct 30 01:17:31.426980 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 379/760] 10.222.0.26 () {60 vars in 1316 bytes} [Sun Oct 30 01:17:31 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:17:32.429889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:32.433318 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:32.442463 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.443107 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.443827 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.444886 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.445738 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.446303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.487858 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a9ba627a-7b0a-4e98-97a2-2fb45b8ddb79 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062602 Oct 30 01:17:32.488790 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 382/761] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:32 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:17:32.566488 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:32.567436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:32.574165 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.574660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.575092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.575826 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.576276 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.576690 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.609554 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:32.938319 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-775185dd-f182-4d71-8702-55ccdb438883 req-a96015f0-fb3a-41b8-8142-ed8ed3e31a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4daf78ff-76d5-4869-a92a-e0b67f4721b3", "tag": "048da4f3-1d63-47ae-b4af-333cac47dd73"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:32.951226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-775185dd-f182-4d71-8702-55ccdb438883 req-a96015f0-fb3a-41b8-8142-ed8ed3e31a97 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.951932 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-775185dd-f182-4d71-8702-55ccdb438883 req-a96015f0-fb3a-41b8-8142-ed8ed3e31a97 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.952458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-775185dd-f182-4d71-8702-55ccdb438883 req-a96015f0-fb3a-41b8-8142-ed8ed3e31a97 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.971002 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-775185dd-f182-4d71-8702-55ccdb438883 req-a96015f0-fb3a-41b8-8142-ed8ed3e31a97 service nova] Creating event network-changed:048da4f3-1d63-47ae-b4af-333cac47dd73 for instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 on hv-cinder-maste Oct 30 01:17:32.977199 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-775185dd-f182-4d71-8702-55ccdb438883 req-a96015f0-fb3a-41b8-8142-ed8ed3e31a97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044064 Oct 30 01:17:32.978296 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 383/762] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:32.988630 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-83ecdd11-f886-485d-bbc1-fff527d5e215 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 204 len: 0 microversion: 2.1 time: 0.426921 Oct 30 01:17:32.989328 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 380/763] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:17:32 2022] DELETE /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:32.999066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:32.999973 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:33.007286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.007828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.008276 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.008990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.009447 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.009874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.157855 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:33.166734 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e9693642-ce85-4d90-90bc-456a6bae6f67 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1681 microversion: 2.1 time: 0.172062 Oct 30 01:17:33.167336 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 384/764] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:32 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:34.194036 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:34.194914 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:34.198012 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:34.204142 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:34.204968 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:34.205604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:34.206622 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:34.207403 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:34.207959 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:34.431577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:34.441556 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-300a8f4d-12f6-46c4-b8ca-277818f2745c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1681 microversion: 2.1 time: 0.252213 Oct 30 01:17:34.442239 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 381/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:34 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:35.469420 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:35.471314 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:35.477135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:35.485992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.486786 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.488284 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.489685 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.490506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.491336 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.698455 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:35.707682 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9f6278db-1736-4b3e-a54b-aa2cd7777aef tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1681 microversion: 2.1 time: 0.244279 Oct 30 01:17:35.708310 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 385/766] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:35 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:36.117196 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-543f1beb-22da-4894-9268-f50eaf4a3d41 req-838c2c3f-a491-46b1-94b5-d2a9cba162b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc02e945-abfb-4689-b7b1-753df25b5f53", "name": "network-vif-deleted", "tag": "0b17abf8-3601-4323-b7df-62e623f6a142"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:36.129700 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-543f1beb-22da-4894-9268-f50eaf4a3d41 req-838c2c3f-a491-46b1-94b5-d2a9cba162b3 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.130446 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-543f1beb-22da-4894-9268-f50eaf4a3d41 req-838c2c3f-a491-46b1-94b5-d2a9cba162b3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.131282 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-543f1beb-22da-4894-9268-f50eaf4a3d41 req-838c2c3f-a491-46b1-94b5-d2a9cba162b3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.145938 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-543f1beb-22da-4894-9268-f50eaf4a3d41 req-838c2c3f-a491-46b1-94b5-d2a9cba162b3 service nova] Creating event network-vif-deleted:0b17abf8-3601-4323-b7df-62e623f6a142 for instance bc02e945-abfb-4689-b7b1-753df25b5f53 on hv-cinder-maste Oct 30 01:17:36.151832 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-543f1beb-22da-4894-9268-f50eaf4a3d41 req-838c2c3f-a491-46b1-94b5-d2a9cba162b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038528 Oct 30 01:17:36.152868 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 382/767] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:36.736273 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:36.737627 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:36.748318 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.749020 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.749674 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.750653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.751336 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.751924 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.816901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.817690 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.818277 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.819019 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lazy-loading 'fault' on Instance uuid bc02e945-abfb-4689-b7b1-753df25b5f53 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:36.879376 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:36.888991 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f042474b-fb7f-4865-88d9-a4d76d81ff6b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 200 len: 1331 microversion: 2.1 time: 0.157224 Oct 30 01:17:36.905537 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 386/768] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:36 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:37.916291 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:37.917088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:37.925099 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.925615 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.926022 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.926727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.927198 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.927626 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.942860 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 HTTP/1.1 Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:17:37.944952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:17:37.947495 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'bc02e945-abfb-4689-b7b1-753df25b5f53'} Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:37.949038 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:17:37.951786 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:17:37.954235 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:37.954235 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-350be0c2-c070-4c05-808a-cdeed090620d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 404 len: 111 microversion: 2.1 time: 0.035026 Oct 30 01:17:37.954235 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 383/769] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:37 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:17:37.959575 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0b8aace1-7224-4899-9e15-ae0b66db8471 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '.version_select at 0x7f0487dc6ca0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:38.052396 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0b8aace1-7224-4899-9e15-ae0b66db8471 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650161120" status: 202 len: 0 microversion: 2.1 time: 0.097652 Oct 30 01:17:38.053009 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 387/770] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 30 01:17:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650161120 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:17:38.989363 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-18973888-8e53-4987-8878-389ac13b43af tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: .version_select at 0x7f048c3225e0>, body: {"keypair": {"name": "tempest-keypair-905892296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKifCQqhfTblFi9X5/vgJmexYgyge8m/hZZ+UOu2JlgUoaYiihMzS+Y2AU5U+lsuwG8npstHMYFTlEAMp6fC5bMAPXyiLvPBbmtM902fQluKs6QQU4fuZa30HafHmdU15g=="}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:39.007015 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-18973888-8e53-4987-8878-389ac13b43af tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:39.012220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-18973888-8e53-4987-8878-389ac13b43af tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:39.107761 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-18973888-8e53-4987-8878-389ac13b43af tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122315 Oct 30 01:17:39.108382 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 384/771] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:17:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:41.820738 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-326186299", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "843e4324-5c32-4e7f-add7-0c4eec3b7e77"}], "security_groups": [{"name": "tempest-securitygroup--282920677"}], "key_name": "tempest-keypair-905892296", "user_data": "}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:41.958027 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] validate_networks() for [('843e4324-5c32-4e7f-add7-0c4eec3b7e77', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:17:42.375349 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:42.375802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:42.379746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:42.379746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:42.379746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:42.387644 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.388135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.388567 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.389291 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.389748 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.390171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.409467 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:42.414149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:42.427393 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:17:42.429871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:17:42.603187 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d3842af9-92db-4dba-ad34-bf5a4a2d32df tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.791706 Oct 30 01:17:42.604705 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 388/772] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:17:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:17:42.617839 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-956f8335-2b5f-42b3-b3da-dca5ed88d12d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:42.618477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-956f8335-2b5f-42b3-b3da-dca5ed88d12d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:42.685434 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-956f8335-2b5f-42b3-b3da-dca5ed88d12d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:42.693551 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-956f8335-2b5f-42b3-b3da-dca5ed88d12d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1240 microversion: 2.1 time: 0.080207 Oct 30 01:17:42.694139 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 385/773] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:42 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:43.722636 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:43.723841 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:43.733826 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:43.734550 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:43.735244 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:43.736559 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:43.737523 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:43.737891 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:43.835175 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:43.849837 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-83a959ff-86d8-475d-a3fa-b163b5d0101d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1244 microversion: 2.1 time: 0.135589 Oct 30 01:17:43.850913 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 389/774] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:43 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:44.875475 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:44.876504 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:44.885065 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.885563 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.886003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.886745 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.887245 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.887692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.961119 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:44.970396 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e35182e0-5ecd-4c97-b59e-c6f5698c6e01 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1292 microversion: 2.1 time: 0.099313 Oct 30 01:17:44.971808 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 386/775] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:44 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:45.998391 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:45.999278 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:46.006749 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.007235 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.007746 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.008459 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.009053 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.009481 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.331089 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:46.340913 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-437ca1bf-e8f8-4687-abf1-6c0dd36bd1ab tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.346642 Oct 30 01:17:46.341890 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 390/776] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:45 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:47.376646 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:47.377848 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:47.388405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:47.389208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:47.390041 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.391359 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:47.392181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:47.393584 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.643689 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:47.653444 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-501f6aa8-0254-41d7-be54-dc94a991e8ac tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.280829 Oct 30 01:17:47.659290 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 387/777] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:47 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:47.776389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-a301634c-b18e-4284-9f4a-a6c63659ff7b req-5d7d50d9-41cc-4a1d-91b1-2ada53b7b829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdeab19-9694-47d7-b99e-f9f2e77a521a", "tag": "1fa719d9-47db-40bc-a49b-33886b04e612"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:47.786986 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a301634c-b18e-4284-9f4a-a6c63659ff7b req-5d7d50d9-41cc-4a1d-91b1-2ada53b7b829 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:47.787992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a301634c-b18e-4284-9f4a-a6c63659ff7b req-5d7d50d9-41cc-4a1d-91b1-2ada53b7b829 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:47.787992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-a301634c-b18e-4284-9f4a-a6c63659ff7b req-5d7d50d9-41cc-4a1d-91b1-2ada53b7b829 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.801138 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-a301634c-b18e-4284-9f4a-a6c63659ff7b req-5d7d50d9-41cc-4a1d-91b1-2ada53b7b829 service nova] Creating event network-changed:1fa719d9-47db-40bc-a49b-33886b04e612 for instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a on hv-cinder-maste Oct 30 01:17:47.806858 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-a301634c-b18e-4284-9f4a-a6c63659ff7b req-5d7d50d9-41cc-4a1d-91b1-2ada53b7b829 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Oct 30 01:17:47.807472 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 391/778] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:17:48.681045 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:48.682133 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:48.690658 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:48.691198 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:48.691808 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:48.696062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:48.696062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:48.696062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:48.894932 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:48.903226 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c33e5852-18db-4c74-b1f6-679b8d74d934 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.228677 Oct 30 01:17:48.903869 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 388/779] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:48 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:49.943062 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:49.943918 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:49.950560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.951051 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.951490 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.952242 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.952702 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.953127 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.125778 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:50.134495 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-653ebe79-17c4-4f9c-bf02-d8a4b2bb541b tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.196440 Oct 30 01:17:50.135218 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 392/780] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:49 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:51.172058 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:51.172712 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:51.180221 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.180710 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.181143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.181851 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.182308 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.182730 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.327440 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:51.336563 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-703873dc-bf31-4395-80f6-0eaf9032d9f8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.168320 Oct 30 01:17:51.337152 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 389/781] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:51 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:52.360795 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:52.361441 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:52.368908 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.369390 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.369821 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.370525 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.371005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.371423 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.398886 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:52.422163 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=6 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:52.523267 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:52.531519 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9c856f8f-3716-419e-b1cb-e53c973939d5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.174802 Oct 30 01:17:52.532139 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 393/782] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:52 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:53.560345 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.561702 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.566022 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:53.573936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.574827 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.575499 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.576472 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.577004 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.577640 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.755199 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.769647 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f62da13f-4581-4437-bb12-a49b790b56eb tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.216396 Oct 30 01:17:53.770710 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 390/783] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:53.874648 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-cf1d97df-9e96-4be1-99a4-34007f1d6599 req-3361d9c6-5234-41c9-bfd7-08972415aba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdeab19-9694-47d7-b99e-f9f2e77a521a", "name": "network-vif-plugged", "status": "completed", "tag": "1fa719d9-47db-40bc-a49b-33886b04e612"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:53.893644 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-cf1d97df-9e96-4be1-99a4-34007f1d6599 req-3361d9c6-5234-41c9-bfd7-08972415aba4 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.894480 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-cf1d97df-9e96-4be1-99a4-34007f1d6599 req-3361d9c6-5234-41c9-bfd7-08972415aba4 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.895253 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-cf1d97df-9e96-4be1-99a4-34007f1d6599 req-3361d9c6-5234-41c9-bfd7-08972415aba4 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.915547 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-cf1d97df-9e96-4be1-99a4-34007f1d6599 req-3361d9c6-5234-41c9-bfd7-08972415aba4 service nova] Creating event network-vif-plugged:1fa719d9-47db-40bc-a49b-33886b04e612 for instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a on hv-cinder-maste Oct 30 01:17:53.923146 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-cf1d97df-9e96-4be1-99a4-34007f1d6599 req-3361d9c6-5234-41c9-bfd7-08972415aba4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056002 Oct 30 01:17:53.924519 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 394/784] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:17:54.805781 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:54.806393 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:54.813583 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.814102 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.815032 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.815811 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.816268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.816690 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.961014 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.970046 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bfc126ab-a859-45bd-b495-6b4b27a14a20 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1365 microversion: 2.1 time: 0.168105 Oct 30 01:17:54.970578 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 391/785] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:54 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:55.994127 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:55.994848 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:56.001387 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.001876 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.002311 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.003017 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.003553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.004026 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.152094 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.161046 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b9101938-7cd8-4589-ada5-6d9d45b4dcba tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1554 microversion: 2.1 time: 0.171563 Oct 30 01:17:56.161646 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 395/786] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:55 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:56.187991 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:56.188636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:56.195701 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.196256 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.196797 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.197574 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.198175 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.198700 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.286817 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-e99aa6dd-0dab-41b9-85fb-7988d7759d9f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102613 Oct 30 01:17:56.287911 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 392/787] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:17:56 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:57.460238 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-9e9f1f4e-aab9-4a1c-84b4-5a6a7d6a1e11 req-6cc3ec95-6455-44ee-803c-d78ed6418192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdeab19-9694-47d7-b99e-f9f2e77a521a", "tag": "1fa719d9-47db-40bc-a49b-33886b04e612"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:57.482947 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e9f1f4e-aab9-4a1c-84b4-5a6a7d6a1e11 req-6cc3ec95-6455-44ee-803c-d78ed6418192 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.483880 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e9f1f4e-aab9-4a1c-84b4-5a6a7d6a1e11 req-6cc3ec95-6455-44ee-803c-d78ed6418192 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.484666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-9e9f1f4e-aab9-4a1c-84b4-5a6a7d6a1e11 req-6cc3ec95-6455-44ee-803c-d78ed6418192 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.506802 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-9e9f1f4e-aab9-4a1c-84b4-5a6a7d6a1e11 req-6cc3ec95-6455-44ee-803c-d78ed6418192 service nova] Creating event network-changed:1fa719d9-47db-40bc-a49b-33886b04e612 for instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a on hv-cinder-maste Oct 30 01:17:57.516668 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-9e9f1f4e-aab9-4a1c-84b4-5a6a7d6a1e11 req-6cc3ec95-6455-44ee-803c-d78ed6418192 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059611 Oct 30 01:17:57.518313 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 396/788] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:09.242260 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:09.243051 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:09.247280 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:09.247807 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:09.254884 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.260204 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.260204 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.260204 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.260204 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.260766 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.287264 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f2ee9e50-7730-4cb3-a5b4-95949403c79d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/ips" status: 200 len: 151 microversion: 2.20 time: 0.046590 Oct 30 01:18:09.287931 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 393/789] 10.222.0.26 () {60 vars in 1289 bytes} [Sun Oct 30 01:18:09 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:18:11.486955 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:11.487567 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:11.490053 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:11.490724 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:11.496176 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.496671 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.497111 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.497828 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.498287 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.498712 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.568446 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lazy-loading 'flavor' on Instance uuid 4daf78ff-76d5-4869-a92a-e0b67f4721b3 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:12.214026 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a1e50d1c-6e26-4b80-8520-4dbe1c9df6de tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/action" status: 202 len: 0 microversion: 2.20 time: 0.732816 Oct 30 01:18:12.215155 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 397/790] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 30 01:18:11 2022] POST /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:12.225716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:12.226432 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:12.235520 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.243812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.243812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.243812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.243812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.244459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.407991 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:12.417071 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:12.418544 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:12.419784 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-229c75cb-1323-48bd-a146-3fd0a6539f97 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.198868 Oct 30 01:18:12.420345 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 394/791] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:12 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:13.452858 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:13.453699 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:13.460723 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:13.461209 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:13.461649 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.462348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:13.462794 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:13.463229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.640850 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.650182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.651668 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.652873 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0cf910fc-6776-4f3a-bbb8-ad78a672e7b3 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.204962 Oct 30 01:18:13.653444 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 398/792] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:13 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:14.680557 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:14.681391 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:14.688908 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:14.689405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:14.689833 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:14.690540 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:14.690996 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:14.691420 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:14.830867 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:14.839685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:14.841147 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:14.842342 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5f6a2cf0-ec6c-43ab-b847-de7113b059be tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.166004 Oct 30 01:18:14.842908 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 395/793] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:14 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:15.870852 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:15.871438 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:15.878277 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:15.878767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:15.879200 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:15.879941 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:15.880393 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:15.880815 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:16.047765 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:16.056970 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:16.058410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:16.059612 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c0edccd8-7c3b-4abe-9f56-7906f03a3d99 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.192733 Oct 30 01:18:16.060191 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 399/794] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:15 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:17.088341 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:17.088341 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:17.093920 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:17.094428 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:17.095466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:17.096207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:17.096668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:17.097088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:17.256653 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:17.265501 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:17.267506 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:17.268746 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-06be2e9a-3cd1-42b2-929c-7c21fd7bd78a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.186556 Oct 30 01:18:17.269306 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 396/795] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:17 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:18.294504 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:18.295161 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:18.301945 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:18.302403 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:18.302834 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:18.303536 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:18.304015 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:18.304431 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:18.464172 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:18.473441 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:18.475024 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:18.476309 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-37fe5ea5-12c4-4a4c-8118-796930685799 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.185748 Oct 30 01:18:18.476899 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 400/796] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:18 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:19.502135 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:19.503133 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:19.509966 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:19.510453 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:19.510897 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:19.511632 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:19.512092 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:19.512519 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:19.663816 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:19.677803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:19.679870 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:19.682019 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-cbc7135d-ac6e-41fb-b020-15951b31a37d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.183618 Oct 30 01:18:19.683004 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 397/797] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:19 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:20.709137 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:20.709756 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:20.716703 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.717303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.717790 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.718547 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.719046 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.720179 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:21.030539 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:21.040313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:21.041751 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:21.042953 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6ea8c1a7-ad1f-4f4d-9f19-04867be94d33 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.337710 Oct 30 01:18:21.043509 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 401/798] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:20 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:22.071093 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:22.072017 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:22.081696 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.082501 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.083190 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.084382 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.085132 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.085883 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.260768 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:22.270313 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:22.271885 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:22.273094 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-19f167a2-34ac-4534-bfc7-5daf5ea664d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.206784 Oct 30 01:18:22.273660 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 398/799] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:22 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:23.299128 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.299905 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:23.306716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.307210 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.307678 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.308386 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.308841 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.309267 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.452641 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.461386 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.462823 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.464044 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e0ef48e8-5808-4e96-95f2-f238ec84323a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1745 microversion: 2.20 time: 0.169414 Oct 30 01:18:23.464604 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 402/800] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:23 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:24.491617 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:24.492297 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:24.499415 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.499945 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.500382 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.501685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.502139 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.502561 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.656508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:24.665675 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:24.667154 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:24.668406 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1b1ce1e8-b8ed-4646-9f42-9ef1dcf58fcf tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1745 microversion: 2.20 time: 0.181032 Oct 30 01:18:24.669288 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 399/801] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:24 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:25.704598 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:25.705730 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:25.717814 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.718669 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.719449 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.720749 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.721565 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.722331 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.938977 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.949269 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.950729 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.951952 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-44f8a60d-accd-40c2-a456-e8908cdb072d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.255766 Oct 30 01:18:25.952500 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 403/802] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:25 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:25.973994 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-fbb524b6-1f06-4942-8db6-fcf47b871e38 req-0e86ed70-1591-4a35-b37e-dd4fa4fb7ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daf78ff-76d5-4869-a92a-e0b67f4721b3", "name": "network-vif-plugged", "status": "completed", "tag": "048da4f3-1d63-47ae-b4af-333cac47dd73"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:25.984847 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-fbb524b6-1f06-4942-8db6-fcf47b871e38 req-0e86ed70-1591-4a35-b37e-dd4fa4fb7ac7 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.985531 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-fbb524b6-1f06-4942-8db6-fcf47b871e38 req-0e86ed70-1591-4a35-b37e-dd4fa4fb7ac7 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.985866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-fbb524b6-1f06-4942-8db6-fcf47b871e38 req-0e86ed70-1591-4a35-b37e-dd4fa4fb7ac7 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.998681 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-fbb524b6-1f06-4942-8db6-fcf47b871e38 req-0e86ed70-1591-4a35-b37e-dd4fa4fb7ac7 service nova] Creating event network-vif-plugged:048da4f3-1d63-47ae-b4af-333cac47dd73 for instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 on hv-cinder-maste Oct 30 01:18:26.005718 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-fbb524b6-1f06-4942-8db6-fcf47b871e38 req-0e86ed70-1591-4a35-b37e-dd4fa4fb7ac7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036077 Oct 30 01:18:26.006488 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 400/803] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:26.986603 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:26.988082 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:26.998635 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:26.999414 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:27.000094 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:27.001566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:27.002103 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:27.002593 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:27.226792 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:27.241924 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:27.246925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:27.248543 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6f95a57a-34d3-4c00-9440-62e076a83ebb tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.270362 Oct 30 01:18:27.249347 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 404/804] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:26 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:28.305128 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:28.306418 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:28.319959 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:28.321627 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:28.323068 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:28.324840 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:28.326036 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:28.329699 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:28.547941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:28.559263 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:28.562470 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:28.564979 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5a5c9bd7-0623-4a9c-b4e1-82d5320d12ce tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.276887 Oct 30 01:18:28.566659 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 401/805] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:28 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:29.600611 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:29.601530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:29.608632 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.609129 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.609569 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.610295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.610831 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.611220 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.795440 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.804295 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.806261 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.807913 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5afc6dea-77bb-47db-83a9-d2115ae336ea tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.211188 Oct 30 01:18:29.808488 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 405/806] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:29 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:30.856168 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:30.858403 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:30.880231 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.881584 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.882773 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.884290 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.885372 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.886404 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.113755 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:31.127062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:31.128830 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:31.130651 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-dba93221-4aa2-4ed3-8c4b-132d6f304682 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.282745 Oct 30 01:18:31.148896 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 402/807] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:30 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:32.166100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:32.169155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:32.176832 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.177660 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.178820 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.181743 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.182841 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.183610 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.378764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:32.392786 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:32.395964 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:32.398316 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-93b8c2f5-da90-4a8b-9aec-bb893c21ae48 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.237698 Oct 30 01:18:32.399380 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 406/808] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:32 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:33.429862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:33.431369 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:33.441237 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.442268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.443934 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.445205 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.446012 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.446785 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.631294 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:33.632219 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:33.640313 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.648863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.648863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.648863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.648863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.649516 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.649659 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:33.659448 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:33.661245 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:33.663384 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c3d30308-e1a6-4a43-a619-ae412d1b486d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.237755 Oct 30 01:18:33.683727 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 403/809] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:33 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:33.694135 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e3300228-2914-4637-9db6-57ec7d7cb383 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/ips" status: 200 len: 149 microversion: 2.1 time: 0.067035 Oct 30 01:18:33.696057 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 407/810] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:18:33 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/ips => generated 149 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:34.695062 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:34.696250 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:34.710317 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.711658 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.712964 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:34.714797 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.716035 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.717218 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.217276 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:35.229657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:35.232757 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:35.235030 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4c686c2b-cdf3-4874-ba5b-f5b5b20e7fc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.545659 Oct 30 01:18:35.236266 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 404/811] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:34 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:35.636186 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8e63c46-1dd8-4f99-ad38-54ff3ac9160d"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:35.641007 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:35.650149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.651046 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.651817 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.652621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.653415 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.654258 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.264660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:36.265311 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:36.273392 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.273896 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.274486 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.275254 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.275812 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.276238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.438997 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.454604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.457651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.459746 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-369f8ec5-0769-4011-a0a1-4d5b0d2db661 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.200785 Oct 30 01:18:36.460338 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 405/812] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:36 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:37.146561 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a8d7fc12-0a2c-49e5-984e-0eacd2ec2df6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.517269 Oct 30 01:18:37.148420 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 408/813] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:18:35 2022] POST /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments => generated 194 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:18:37.492169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:37.494424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:37.507817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.508718 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.509504 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.510866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.512008 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.512930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.684544 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:37.693492 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:37.694932 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:37.696225 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4fa81e7f-e79e-4f9a-a927-6e46e528fd72 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.212588 Oct 30 01:18:37.696801 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 406/814] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:37 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:38.723750 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:38.724461 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:38.731603 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.732118 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.732550 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.733280 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.733733 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.734181 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.890184 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.900217 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.901686 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.902895 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-483f4d63-802b-499a-935f-f3b9d17b54f4 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1740 microversion: 2.20 time: 0.184762 Oct 30 01:18:38.903478 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 409/815] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:38 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:39.529432 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8e63c46-1dd8-4f99-ad38-54ff3ac9160d"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:39.532073 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:39.539385 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.539907 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.540338 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.541052 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.541542 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.542000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.645660 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Invalid volume: volume f8e63c46-1dd8-4f99-ad38-54ff3ac9160d is already attached to instances: 7cdeab19-9694-47d7-b99e-f9f2e77a521a Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: POST /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments HTTP/1.1 Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 74 Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:18:39.646694 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: {"volumeAttachment": {"volumeId": "f8e63c46-1dd8-4f99-ad38-54ff3ac9160d"}} Oct 30 01:18:39.649886 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Invalid volume: volume f8e63c46-1dd8-4f99-ad38-54ff3ac9160d is already attached to instances: 7cdeab19-9694-47d7-b99e-f9f2e77a521a Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'server_id': '7cdeab19-9694-47d7-b99e-f9f2e77a521a', 'body': {'volumeAttachment': {'volumeId': 'f8e63c46-1dd8-4f99-ad38-54ff3ac9160d'}}} Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f8e63c46-1dd8-4f99-ad38-54ff3ac9160d is already attached to instances: 7cdeab19-9694-47d7-b99e-f9f2e77a521a Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:18:39.651675 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f8e63c46-1dd8-4f99-ad38-54ff3ac9160d is already attached to instances: 7cdeab19-9694-47d7-b99e-f9f2e77a521a Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:39.657294 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f8e63c46-1dd8-4f99-ad38-54ff3ac9160d is already attached to instances: 7cdeab19-9694-47d7-b99e-f9f2e77a521a Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 400 to user: Invalid volume: volume f8e63c46-1dd8-4f99-ad38-54ff3ac9160d is already attached to instances: 7cdeab19-9694-47d7-b99e-f9f2e77a521a {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0b7267a9-5ae5-47d2-80ce-7a08cc41b60a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123018 Oct 30 01:18:39.661759 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 407/816] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:18:39 2022] POST /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:18:39.735221 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:39.736114 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:39.743044 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.743542 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.744160 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.744745 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.745206 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.745633 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.766624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:39.840276 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lazy-loading 'services' on Instance uuid 7cdeab19-9694-47d7-b99e-f9f2e77a521a {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:39.942735 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:39.943393 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:39.954482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.956904 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.956904 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.956904 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.956904 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.957500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.079958 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-bb64dd36-6ff2-4534-89e7-ecf03500cb5a tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments/f8e63c46-1dd8-4f99-ad38-54ff3ac9160d" status: 202 len: 0 microversion: 2.1 time: 0.348124 Oct 30 01:18:40.081072 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 410/817] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:18:39 2022] DELETE /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments/f8e63c46-1dd8-4f99-ad38-54ff3ac9160d => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:40.094698 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:40.098827 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.111113 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.111922 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.114458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.114458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.114458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.114458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.144042 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.154280 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.156103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.156490 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-713288e7-4c4a-47b0-bc12-56cd471e6c8e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067728 Oct 30 01:18:40.157305 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 411/818] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:40 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:18:40.157784 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-72fc8ed7-3ac0-4df0-9283-436aac730fd7 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1722 microversion: 2.20 time: 0.219195 Oct 30 01:18:40.158784 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 408/819] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:39 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:40.202793 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:40.204158 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.211255 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.211803 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.217616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.217616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.217616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.217616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.241664 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lazy-loading 'flavor' on Instance uuid 37986d61-58aa-43a7-95eb-99ab0e188914 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:40.516384 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-88ed4ddd-35f8-4ada-9e10-a639f448dbcb tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "POST /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914/action" status: 202 len: 0 microversion: 2.1 time: 0.316981 Oct 30 01:18:40.525712 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 412/820] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:18:40 2022] POST /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:40.529977 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:40.531844 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.544465 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.545353 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.546111 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.547267 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.548054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.548810 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.710692 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.719441 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a76bae6b-8803-441e-a89f-191e9d0a11df tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.197219 Oct 30 01:18:40.720081 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 409/821] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:40 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:41.172383 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:41.175105 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:41.182956 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.183454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.183957 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.184674 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.185129 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.185553 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.196055 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:41.197138 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:41.208427 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.209294 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.210063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.211331 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.212169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.212909 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.222534 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-81abb7be-673b-4290-b1a7-b634c6cdf438 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055495 Oct 30 01:18:41.223125 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 413/822] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:41 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:41.250592 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:41.389533 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:41.399238 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:41.400955 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:41.402223 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bdf23311-5423-432b-b376-e05fede057c6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1722 microversion: 2.20 time: 0.214932 Oct 30 01:18:41.403009 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 410/823] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:41 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:41.752499 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:41.753163 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:41.759677 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.760180 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.760624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.761348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.761811 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.762243 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.969728 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:41.985214 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5fe9a5d0-1488-4b6d-9ea6-ed7bc12d9470 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.236432 Oct 30 01:18:41.986068 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-39a97c2b-986e-4855-916a-cb194edced33 req-b6ca624c-cc73-4f25-b6ef-1fe70fd7103c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daf78ff-76d5-4869-a92a-e0b67f4721b3", "name": "network-vif-unplugged", "status": "completed", "tag": "048da4f3-1d63-47ae-b4af-333cac47dd73"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:41.986778 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 414/824] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:41 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:42.006860 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-39a97c2b-986e-4855-916a-cb194edced33 req-b6ca624c-cc73-4f25-b6ef-1fe70fd7103c service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.007875 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-39a97c2b-986e-4855-916a-cb194edced33 req-b6ca624c-cc73-4f25-b6ef-1fe70fd7103c service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.008674 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-39a97c2b-986e-4855-916a-cb194edced33 req-b6ca624c-cc73-4f25-b6ef-1fe70fd7103c service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.025702 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-39a97c2b-986e-4855-916a-cb194edced33 req-b6ca624c-cc73-4f25-b6ef-1fe70fd7103c service nova] Creating event network-vif-unplugged:048da4f3-1d63-47ae-b4af-333cac47dd73 for instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 on hv-cinder-maste Oct 30 01:18:42.031958 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-39a97c2b-986e-4855-916a-cb194edced33 req-b6ca624c-cc73-4f25-b6ef-1fe70fd7103c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051036 Oct 30 01:18:42.032843 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 411/825] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:18:42.235187 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:42.237410 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:42.240101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=37 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:42.245177 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.245677 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.246123 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.246834 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.247297 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.247835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.291228 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e1bf4cc0-6dc5-43ee-a0ec-a0ee86ff3da8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060198 Oct 30 01:18:42.291893 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 415/826] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:42 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:42.433729 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:42.434702 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:42.446947 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.447796 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.448659 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.449961 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.452134 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.452134 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.627515 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:42.638146 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:42.640048 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:42.641388 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4598670e-b4a3-40a7-abc4-2d2dfb6941d9 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1725 microversion: 2.20 time: 0.215718 Oct 30 01:18:42.642118 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 412/827] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:42 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:42.667641 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a002afc9-968f-4cf9-a314-8232bbebd960"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:42.670147 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:42.677625 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.677975 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.678420 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.679144 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.679632 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.680066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.026048 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:43.026984 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:43.036046 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.036661 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.037220 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.038114 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.038662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.039176 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.198773 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:43.207316 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f7835590-5445-4370-bbbf-16dd7fd5225b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.185263 Oct 30 01:18:43.208148 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 413/828] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:43 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:43.304915 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:43.307373 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:43.314436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.314996 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.315468 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.316376 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.316884 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.317382 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.352853 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b54438ea-98ff-4668-98f1-3d56e8a6f33f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052098 Oct 30 01:18:43.353630 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 414/829] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:43 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:18:43.426801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:43.427356 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:43.434592 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.438559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.438559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.438559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.438559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.439172 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.469663 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:43.979250 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1fc44fe5-539d-45a5-a6f7-9dd1552c719d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 204 len: 0 microversion: 2.1 time: 0.556447 Oct 30 01:18:43.980285 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 415/830] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:43 2022] DELETE /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:18:43.989658 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:43.990394 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:43.996813 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.997300 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.997731 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.998442 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.998888 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.999355 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.008303 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-5fe00701-6eee-479d-9368-c9f3f4913579 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.344641 Oct 30 01:18:44.009310 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 416/831] 10.222.0.26 () {62 vars in 1364 bytes} [Sun Oct 30 01:18:42 2022] POST /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-volume_attachments => generated 188 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:18:44.196430 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:44.211530 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f7ab6821-4b70-44d4-b1dd-f0524cbd7d46 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1679 microversion: 2.1 time: 0.225888 Oct 30 01:18:44.212523 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 416/832] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:43 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:44.215039 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:44.215417 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:44.228440 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.229333 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.230642 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.232459 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.233283 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.233478 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:44.234256 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:44.234833 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.242540 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.243765 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.244492 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.245886 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.246456 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.246956 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.435494 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:44.447252 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-46d485cb-5e8c-4a1d-bdd0-d3b6eb5a9bcd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.219748 Oct 30 01:18:44.448068 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 417/833] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:44 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:44.880808 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-97ce406a-1ea5-490b-97ff-f9e683c3f031 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-volume_attachments/a002afc9-968f-4cf9-a314-8232bbebd960" status: 202 len: 0 microversion: 2.20 time: 0.673420 Oct 30 01:18:44.881426 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 417/834] 10.222.0.26 () {60 vars in 1457 bytes} [Sun Oct 30 01:18:44 2022] DELETE /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-volume_attachments/a002afc9-968f-4cf9-a314-8232bbebd960 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:44.952269 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:44.953459 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:44.955712 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:44.961538 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.962030 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.962466 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.963186 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.963741 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.964164 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.999756 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119523) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:18:45.254864 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:45.255514 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:45.262834 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.263326 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.263797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.264519 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.264974 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.265972 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.284245 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8f053199-5648-469d-904d-a3d7ddbf5cc0 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "POST /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/action" status: 202 len: 0 microversion: 2.20 time: 0.336149 Oct 30 01:18:45.285227 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 418/835] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Oct 30 01:18:44 2022] POST /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:45.293188 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:45.294034 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:45.302355 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.303072 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.303454 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.304285 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.304806 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.305479 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.519389 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:45.526555 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:45.535613 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-da82ad3a-7210-4605-a493-428df136b989 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1679 microversion: 2.1 time: 0.284719 Oct 30 01:18:45.536902 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 418/836] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:45 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1679 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:45.542850 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:45.545458 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:45.548242 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-daa8f0c4-a9e5-450a-8fda-325691a3a373 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1673 microversion: 2.20 time: 0.258419 Oct 30 01:18:45.549257 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 419/837] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:45 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:45.570829 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:45.572051 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:45.592899 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.594337 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.595066 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.596303 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.597076 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.597825 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.626309 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=7,nova_cell1:UPDATE=10 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:45.857485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:45.869391 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-80e497d4-4edb-41a1-a0b0-3ed585e1cc09 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.316031 Oct 30 01:18:45.870366 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 419/838] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:45 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:46.572753 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:46.573458 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:46.581916 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.582668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.583078 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.584136 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.584406 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.584751 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.596526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:46.598624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:46.612120 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.613001 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.613802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.615101 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.615891 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.616434 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.923098 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.934120 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-12c5b893-ce69-4383-b106-2d91ae33cea4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1679 microversion: 2.1 time: 0.365225 Oct 30 01:18:46.934725 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 420/839] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:46 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1679 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:46.940172 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:46.941143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:46.948298 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.949103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.949777 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.950684 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.951143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.951614 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.955886 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.963264 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.964752 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.965976 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7e40689b-6911-48fe-94db-ff751207ccc6 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1673 microversion: 2.20 time: 0.377713 Oct 30 01:18:46.966545 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 420/840] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:46 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1673 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:47.176348 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:47.189352 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b7e7a3eb-31f4-4ece-b5fc-354bb62decde tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.253351 Oct 30 01:18:47.190264 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 421/841] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:46 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:47.310901 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-12206337-cfcb-444c-b45c-b2278632a52b req-f3876484-1b48-4923-90e6-0a3d5214b0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdeab19-9694-47d7-b99e-f9f2e77a521a", "name": "network-vif-deleted", "tag": "1fa719d9-47db-40bc-a49b-33886b04e612"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:47.319624 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-12206337-cfcb-444c-b45c-b2278632a52b req-f3876484-1b48-4923-90e6-0a3d5214b0bd service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.320531 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-12206337-cfcb-444c-b45c-b2278632a52b req-f3876484-1b48-4923-90e6-0a3d5214b0bd service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.321322 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-12206337-cfcb-444c-b45c-b2278632a52b req-f3876484-1b48-4923-90e6-0a3d5214b0bd service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.338250 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-12206337-cfcb-444c-b45c-b2278632a52b req-f3876484-1b48-4923-90e6-0a3d5214b0bd service nova] Creating event network-vif-deleted:1fa719d9-47db-40bc-a49b-33886b04e612 for instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a on hv-cinder-maste Oct 30 01:18:47.344207 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-12206337-cfcb-444c-b45c-b2278632a52b req-f3876484-1b48-4923-90e6-0a3d5214b0bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050114 Oct 30 01:18:47.344817 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 421/842] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:47.959064 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:47.960446 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:47.966941 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.967439 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.967912 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.968649 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.969105 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.969536 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.004670 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:48.006096 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:48.013062 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:48.013873 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:48.014666 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.015457 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:48.015960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:48.016399 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.037482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:48.038948 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:48.046070 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.046070 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lazy-loading 'fault' on Instance uuid 7cdeab19-9694-47d7-b99e-f9f2e77a521a {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:48.162621 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.172115 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-82dd9670-63d3-4391-851f-552a64bbe88e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 200 len: 1330 microversion: 2.1 time: 0.216895 Oct 30 01:18:48.172867 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 422/843] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:47 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 1330 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:48.213162 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:48.213775 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:48.221119 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:48.221604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:48.222524 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.223254 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:48.224756 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:48.225193 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.271886 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.293072 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.296989 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.298426 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7ca142ba-6ecf-4dcf-9d20-f956f6f65909 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.299624 Oct 30 01:18:48.300175 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 422/844] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:47 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:48.544584 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.557865 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-035584dc-5e9f-405f-b69b-0957e73687cd tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.348329 Oct 30 01:18:48.559050 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 423/845] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:48 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:49.203076 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:49.203718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:49.211031 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.211532 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.211988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.212749 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.213199 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.213619 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.229652 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a HTTP/1.1 Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:18:49.232343 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:18:49.235457 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '7cdeab19-9694-47d7-b99e-f9f2e77a521a'} Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:49.236939 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:18:49.238874 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:18:49.241991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:49.241991 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4d32b129-b224-47b0-b654-1da1e7b34c15 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 404 len: 111 microversion: 2.1 time: 0.035592 Oct 30 01:18:49.241991 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 423/846] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:49 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:49.244763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-44bb578d-5e6f-4ef5-ba5d-f1d188dcc762 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '.version_select at 0x7f0487cfaaf0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:49.335328 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:49.335973 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:49.342478 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.342965 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.344023 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.344725 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.345173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.345616 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.349729 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-44bb578d-5e6f-4ef5-ba5d-f1d188dcc762 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905892296" status: 202 len: 0 microversion: 2.1 time: 0.108909 Oct 30 01:18:49.350328 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 424/847] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Oct 30 01:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905892296 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:49.550379 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:49.564589 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:49.567730 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:49.569998 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ec903b53-bc71-465d-b118-99a0c824c531 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.238311 Oct 30 01:18:49.571114 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 424/848] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:49 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:49.587817 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:49.588626 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:49.599438 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.600307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.601057 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.602270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.603041 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.603837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.996837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:50.016765 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:50.021662 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7df3651d-3d3f-4d0a-916c-3369b4d7fe93 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.438186 Oct 30 01:18:50.022776 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 425/849] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:49 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:50.613455 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:50.619135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:50.637914 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.639439 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.640953 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:50.642646 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.643570 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.644862 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:50.736417 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-15568e49-1c27-48d2-9f57-42bb58e907e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: .version_select at 0x7f0487c9c160>, body: {"keypair": {"name": "tempest-keypair-1969361371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/mRsoY9cMlxTUriEGQ00rzLAtv1wXv7jqIPNUcj8xikBC7p0NILQoNf9SQxXDOjz8VC8EpCCY1Jc4T2q9PiwVkkSud8dvEQkYJI4DIj129ttcp+5GycibM2jibomJMrg=="}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:50.771189 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-15568e49-1c27-48d2-9f57-42bb58e907e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:18:50.772384 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.quota [None req-15568e49-1c27-48d2-9f57-42bb58e907e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'key_pairs'} {{(pid=119523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:18:50.870600 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-15568e49-1c27-48d2-9f57-42bb58e907e5 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139030 Oct 30 01:18:50.874363 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 426/850] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Oct 30 01:18:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:50.969668 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:50.982335 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:50.984368 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:50.985695 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-d975608a-d4ab-4124-b56b-980f78bcce53 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.385957 Oct 30 01:18:50.986439 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 425/851] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:50 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:51.053789 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:51.055757 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:51.068986 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:51.069877 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:51.070618 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:51.071900 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:51.072597 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:51.073252 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:51.300093 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:51.315738 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2a9b92b6-c051-4653-b565-2d8733e416af tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.270558 Oct 30 01:18:51.316278 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 427/852] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:51 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:52.029477 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:52.030166 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:52.041091 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.042573 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.043348 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.044788 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.045565 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.046930 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.245964 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:52.261095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:52.265223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:52.267309 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b24476cb-b31b-4830-aadc-a2a6735d4f6c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.241937 Oct 30 01:18:52.268550 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 426/853] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:52 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:52.350076 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:52.351170 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:52.362143 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.362636 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.363099 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.365280 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.366128 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.366716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.532575 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:52.546019 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b2455555-c786-4930-8c0c-d4aac6b237a4 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.203972 Oct 30 01:18:52.548600 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 428/854] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:52 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:53.306802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:53.309913 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:53.330972 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.332352 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.334526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.337937 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.341453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.344001 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.587755 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:53.589789 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:53.626226 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.629678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.629678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.629678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.630213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.630613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.650994 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.681072 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.685830 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.689608 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ea3efa14-94c0-4678-a52b-f412b578b771 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.392285 Oct 30 01:18:53.690668 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 427/855] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:53 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:54.158881 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:54.181426 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bb427fca-9daf-4d43-8036-e31c906a7bd5 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.608721 Oct 30 01:18:54.182920 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 429/856] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:53 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:54.324484 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1027738595", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "843e4324-5c32-4e7f-add7-0c4eec3b7e77"}], "security_groups": [{"name": "tempest-securitygroup--509130342"}], "key_name": "tempest-keypair-1969361371", "user_data": "}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:54.589287 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] validate_networks() for [('843e4324-5c32-4e7f-add7-0c4eec3b7e77', None, None, None, None, None)] {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:18:54.751676 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:54.753164 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:54.782222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:54.782222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:54.782222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:54.782222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:54.782622 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:54.782622 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.303508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:55.319411 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:55.321094 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:55.322277 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f1f867b9-b7f7-453e-af3e-4d7d39135dfc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.574704 Oct 30 01:18:55.336624 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 430/857] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:54 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:55.344283 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:55.344283 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:55.359057 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.360020 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.360653 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.362079 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.362896 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.363577 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.972822 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:18:55.973530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:18:55.973636 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:18:55.974015 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:18:55.974424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:18:55.990948 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.991446 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.991912 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.992664 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.993120 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.993544 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.005356 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.018535 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:18:56.020436 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-688644a4-7f53-4bd3-b5ab-9bc831dd5b45 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.696524 Oct 30 01:18:56.021280 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 431/858] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:55 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:56.026849 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Getting quotas for user d09696979ec94a2699d7cb1e2aa77a64 and project cd37394129e346a8804d667856309041. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:18:56.050149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:18:56.055173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:18:56.236336 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-f90476a1-ecd5-4643-b2bc-da26d3cda9e0 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.922481 Oct 30 01:18:56.242930 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 428/859] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:18:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:18:56.255521 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-513f334a-7001-4b37-afdb-e7afac778735 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:56.256394 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-513f334a-7001-4b37-afdb-e7afac778735 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:56.349801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-513f334a-7001-4b37-afdb-e7afac778735 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.352603 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:56.353532 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:56.362637 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-513f334a-7001-4b37-afdb-e7afac778735 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1242 microversion: 2.1 time: 0.112916 Oct 30 01:18:56.364000 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 432/860] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:56 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:56.375762 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.379643 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.380213 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.381050 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.381532 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.381992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.606908 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.616701 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.618190 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.619423 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-a658da9c-4354-4955-ba5c-439849d44394 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.271145 Oct 30 01:18:56.624221 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 429/861] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:56 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:57.052520 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.053547 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.067192 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.068641 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.069685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.071231 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.072325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.073328 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.262284 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.277453 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c21629fe-79de-4dab-afff-a190e61c4994 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.234309 Oct 30 01:18:57.293118 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 433/862] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:57.392413 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c6bcb569-687b-4525-be8e-cc87db232cca tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.397351 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c6bcb569-687b-4525-be8e-cc87db232cca tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.493205 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c6bcb569-687b-4525-be8e-cc87db232cca tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.504251 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c6bcb569-687b-4525-be8e-cc87db232cca tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1242 microversion: 2.1 time: 0.119886 Oct 30 01:18:57.511790 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 430/863] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:57.648500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.649127 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.655734 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.660613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.660613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.660613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.660613 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.661021 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.885439 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.894264 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.895750 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.896963 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c552851f-c70e-43a8-9b69-f3b4a57e3ecc tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.255014 Oct 30 01:18:57.897546 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 434/864] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:58.316210 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:58.316775 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:58.323497 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.324093 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.324536 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.325261 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.325720 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.326145 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.544088 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:58.547070 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:58.550056 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:58.556498 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.557293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.558002 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.559370 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.560195 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.560905 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.564146 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fbaf12c5-08b6-46b0-a92b-f0c03927dd14 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.251832 Oct 30 01:18:58.565122 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 431/865] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:58 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:58.627056 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:58.639132 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-019382f3-5f23-401b-a109-623e413b3b07 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1246 microversion: 2.1 time: 0.099888 Oct 30 01:18:58.640357 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 435/866] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:58 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:58.923988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:58.924511 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:58.931209 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.931734 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.932171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.932883 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.933340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.933760 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.080784 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.090307 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.091835 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.093076 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7a7f50e1-506b-4429-a6c8-82e49f930b37 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.174018 Oct 30 01:18:59.093658 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 432/867] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:58 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:59.589141 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:59.589779 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:59.597432 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.597928 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.598368 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.599085 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.599538 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.599989 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.673761 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:59.674530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:59.683277 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.683892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.684455 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.685517 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.686067 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.686521 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.771113 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.785504 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.785697 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-92a88409-aa4f-45ce-b065-8500a6342fb2 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1238 microversion: 2.1 time: 0.111412 Oct 30 01:18:59.785697 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 433/868] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:59 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1238 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:59.786271 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c5fccc9c-7cf1-46c5-a902-013b542b3dd6 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.200949 Oct 30 01:18:59.786896 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 436/869] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:59 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:00.126105 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:00.126367 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:00.134428 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.135197 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.135802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.136730 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.137315 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.137934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.306823 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:00.317102 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:00.318791 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:00.320073 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-061853b1-7951-4da7-b7a9-0f731d47f404 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.198478 Oct 30 01:19:00.320657 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 434/870] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:00 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:00.810508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:00.814524 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:00.814741 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:00.814741 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:00.821780 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.822268 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.822700 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.823802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.824263 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.824448 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.824764 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.825819 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.826787 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.828657 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.829451 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.830197 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.940421 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:00.950935 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-5ec99fb1-9c2a-404a-8422-b391132d7848 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1294 microversion: 2.1 time: 0.144177 Oct 30 01:19:00.958151 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 437/871] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:00 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1294 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:01.043506 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.056291 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-8fe682fd-512b-4707-bba4-71d0ff510485 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.248880 Oct 30 01:19:01.057355 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 435/872] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:00 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:01.348716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:01.349559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:01.356606 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.357089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.357515 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.358737 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.359250 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.359691 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.596724 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.606275 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.607862 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.609826 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1113e8b8-ee7f-4ff6-8804-30b29b3e8e29 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.265579 Oct 30 01:19:01.611060 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 438/873] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:01 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:01.976169 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:01.976767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:01.984052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.984548 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.985068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.986112 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.986889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.987305 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.078491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:02.094114 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c2572cbb-8e1b-4c37-a9b6-f7b4e77db639 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1312 microversion: 2.1 time: 0.122695 Oct 30 01:19:02.115611 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 436/874] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:01 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:02.115922 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:02.115922 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:02.116447 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-da37f798-e081-4ea0-b25b-3b32c3de9ef1 req-91c78f65-02b4-46db-bfc2-042209ebd006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daf78ff-76d5-4869-a92a-e0b67f4721b3", "name": "network-vif-plugged", "status": "completed", "tag": "048da4f3-1d63-47ae-b4af-333cac47dd73"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:02.116551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.116551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.116551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.116551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.116866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.116866 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.117035 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-da37f798-e081-4ea0-b25b-3b32c3de9ef1 req-91c78f65-02b4-46db-bfc2-042209ebd006 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.117035 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-da37f798-e081-4ea0-b25b-3b32c3de9ef1 req-91c78f65-02b4-46db-bfc2-042209ebd006 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.117035 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-da37f798-e081-4ea0-b25b-3b32c3de9ef1 req-91c78f65-02b4-46db-bfc2-042209ebd006 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.128238 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-da37f798-e081-4ea0-b25b-3b32c3de9ef1 req-91c78f65-02b4-46db-bfc2-042209ebd006 service nova] Creating event network-vif-plugged:048da4f3-1d63-47ae-b4af-333cac47dd73 for instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 on hv-cinder-maste Oct 30 01:19:02.145068 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-da37f798-e081-4ea0-b25b-3b32c3de9ef1 req-91c78f65-02b4-46db-bfc2-042209ebd006 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048539 Oct 30 01:19:02.146202 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 437/875] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:02.385000 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:02.394851 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7ba34bbe-5d08-43b3-accf-1e10da681b6d tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1567 microversion: 2.1 time: 0.299770 Oct 30 01:19:02.395756 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 439/876] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:02 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:02.421159 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:02.421871 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:02.434174 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.434993 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.436149 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.437495 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.439445 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.440338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.498529 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119524) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:19:02.647207 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:02.647877 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:02.655917 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.656533 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.657003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.657788 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.658234 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.658651 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.831886 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:02.845492 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:02.847469 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:02.848768 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-acf59bfc-2752-43e6-848f-6d5495efaa3a tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.205672 Oct 30 01:19:02.849340 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 440/877] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:02 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:19:03.129388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.134279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.149617 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.150171 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.150612 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.153923 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.154672 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.157188 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.383748 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:03.446836 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:03.457622 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-c0b6cc72-c951-4ede-9185-083a5243c21c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.338084 Oct 30 01:19:03.458893 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 441/878] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:03.519482 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-59d7979a-bc44-4b12-acb0-6459317fc9ed tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "POST /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914/action" status: 202 len: 0 microversion: 2.1 time: 1.103234 Oct 30 01:19:03.520641 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 438/879] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Oct 30 01:19:02 2022] POST /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914/action => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:19:03.528122 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.528733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.535064 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.535550 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.536087 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.536789 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.537240 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.537899 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.691712 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:03.700264 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bc3c015b-09f7-409d-a7fd-f62d604bc015 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1515 microversion: 2.1 time: 0.175948 Oct 30 01:19:03.704509 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 442/880] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:03.877807 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.878428 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.885345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.886138 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.886581 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.887290 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.887814 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.888208 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.143471 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:04.152381 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:04.153804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:04.155549 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-4f1beff2-5a82-4b05-94d5-3c30f3996112 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.281974 Oct 30 01:19:04.156471 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 439/881] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:19:04.165881 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-c261c0c3-a93a-4a31-9420-08c3c752c208 req-311dd674-cb37-4d57-97e0-f3f2429d84da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37986d61-58aa-43a7-95eb-99ab0e188914", "name": "network-vif-unplugged", "status": "completed", "tag": "2787be5c-6341-4c37-abbb-ddd900bf4590"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:04.178761 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-c261c0c3-a93a-4a31-9420-08c3c752c208 req-311dd674-cb37-4d57-97e0-f3f2429d84da service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.179152 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-c261c0c3-a93a-4a31-9420-08c3c752c208 req-311dd674-cb37-4d57-97e0-f3f2429d84da service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.179601 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-c261c0c3-a93a-4a31-9420-08c3c752c208 req-311dd674-cb37-4d57-97e0-f3f2429d84da service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.192012 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.compute.server_external_events [req-c261c0c3-a93a-4a31-9420-08c3c752c208 req-311dd674-cb37-4d57-97e0-f3f2429d84da service nova] Unable to find a host for instance 37986d61-58aa-43a7-95eb-99ab0e188914. Dropping event network-vif-unplugged {{(pid=119523) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 01:19:04.193123 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-c261c0c3-a93a-4a31-9420-08c3c752c208 req-311dd674-cb37-4d57-97e0-f3f2429d84da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031517 Oct 30 01:19:04.193745 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 443/882] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 30 01:19:04.481925 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:04.483159 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:04.489499 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.489998 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.490454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.491210 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.491696 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.492117 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.714095 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:04.723878 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3f1a2d02-3eda-407a-8809-b6605501c25f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.245873 Oct 30 01:19:04.724380 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 440/883] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:04 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:04.728905 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:04.730208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:04.741665 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.742336 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.742772 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.743782 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.744492 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.744944 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.846335 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-55a2bafc-c161-4584-b288-7d603b2535c3 req-c601ce94-b016-485e-a641-cbfa093b0bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd9b6064-97b6-4853-ad5c-9efefabb2f02", "tag": "97e77ecd-21bb-4202-8bef-241af78b36ab"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:04.866194 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-55a2bafc-c161-4584-b288-7d603b2535c3 req-c601ce94-b016-485e-a641-cbfa093b0bca service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.868866 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-55a2bafc-c161-4584-b288-7d603b2535c3 req-c601ce94-b016-485e-a641-cbfa093b0bca service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.871127 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-55a2bafc-c161-4584-b288-7d603b2535c3 req-c601ce94-b016-485e-a641-cbfa093b0bca service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.891862 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-55a2bafc-c161-4584-b288-7d603b2535c3 req-c601ce94-b016-485e-a641-cbfa093b0bca service nova] Creating event network-changed:97e77ecd-21bb-4202-8bef-241af78b36ab for instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 on hv-cinder-maste Oct 30 01:19:04.898682 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-55a2bafc-c161-4584-b288-7d603b2535c3 req-c601ce94-b016-485e-a641-cbfa093b0bca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060672 Oct 30 01:19:04.899684 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 441/884] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:19:04.963885 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:04.974149 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4020969f-3dce-47be-a086-122a3b9359c9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1515 microversion: 2.1 time: 0.252827 Oct 30 01:19:04.974807 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 444/885] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:04 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:05.188765 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:05.189760 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:05.201610 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:05.202429 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:05.203323 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:05.204767 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:05.205631 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:05.206402 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:05.445068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:05.456335 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:05.457494 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:05.458899 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-88249afb-68f8-43ee-9b79-4d59b1bfd711 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.279381 Oct 30 01:19:05.459611 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 442/886] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:05 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:05.756376 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:05.757082 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:05.764846 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:05.765340 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:05.765776 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:05.766554 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:05.767041 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:05.767465 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:05.772120 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=100 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:05.974256 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:05.984792 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-77c4305f-3cc5-4b8b-8e0c-593a425487c3 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.232396 Oct 30 01:19:05.985383 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 445/887] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:05 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:06.008334 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.008334 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:06.009658 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:06.019124 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.020028 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.020824 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.022087 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.022934 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.023753 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.182526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:06.191633 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-789a5a13-67e9-41c0-b833-6fa4a8b8d0fa tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1517 microversion: 2.1 time: 0.191920 Oct 30 01:19:06.192290 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 443/888] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:05 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:06.487365 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.488003 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:06.489838 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=6 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:06.494903 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.495396 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.495865 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.496559 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.497029 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.497444 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.632919 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:06.641758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:06.643190 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:06.644419 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0542ae5d-cc88-4eab-9c75-32c62f5f00c2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1731 microversion: 2.20 time: 0.162032 Oct 30 01:19:06.644993 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 446/889] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:06 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:07.017072 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.017779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.024966 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.025456 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.025889 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.026598 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.027056 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.027477 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.207943 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.216021 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-072d1506-8a9f-458e-a872-ddfa47371ab8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.203747 Oct 30 01:19:07.216591 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 444/890] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:07.230958 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.238354 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.239153 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.239738 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.240174 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.240870 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.241322 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.241741 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.387032 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.395455 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-907d1c28-ba79-424c-86c9-f464fc9b2a69 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1517 microversion: 2.1 time: 0.168930 Oct 30 01:19:07.402740 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 447/891] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:07.678990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.678990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.678990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=8 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:07.678990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.678990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.680052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.680052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.680052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.680286 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.818004 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.826360 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.828287 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.829475 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e06cf37b-94e3-4257-b21b-947368ec16d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1718 microversion: 2.20 time: 0.164619 Oct 30 01:19:07.830045 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 445/892] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:08.239191 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:08.239789 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:08.246571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.247054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.247484 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.248234 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.249264 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.249688 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.419530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:08.420178 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:08.428061 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.428555 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.428994 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.429695 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.430182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.430601 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.702943 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:08.708247 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:08.712152 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-4c4b7f5a-c4d0-4d3b-992c-ef1979aee73d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.476997 Oct 30 01:19:08.712940 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 448/893] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:08 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:08.718565 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-fe1d6786-d6ec-451a-8771-8c90844146da tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1573 microversion: 2.1 time: 0.303703 Oct 30 01:19:08.719312 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 446/894] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:08 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1573 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:09.738107 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:09.893444 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:09.893444 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.893444 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.895433 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:09.897660 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.897777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:09.897983 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.897983 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.897983 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.898490 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.898490 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.898490 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.898490 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.899059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.899059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.961177 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:09.969333 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e2336f79-b6fd-4b27-8550-1497b910a8f1 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1573 microversion: 2.1 time: 0.226482 Oct 30 01:19:09.969921 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 447/895] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:09 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1573 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:09.995294 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:10.003702 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b8ee4361-2dcf-4482-8b58-737b3bb0b3b7 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.269887 Oct 30 01:19:10.004300 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 449/896] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:09 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:10.994087 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:10.994687 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:11.001662 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.002144 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.002583 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.003318 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.003811 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.004236 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.027091 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:11.028268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:11.035296 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.035825 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.036261 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.036995 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.037463 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.037950 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.262048 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:11.268802 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:11.276742 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b47714a2-80c0-416c-8a92-812efcc6eb00 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.253529 Oct 30 01:19:11.277334 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 450/897] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:11 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:11.278122 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-affae662-a630-46e9-b1ad-caef5916913c tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1573 microversion: 2.1 time: 0.288034 Oct 30 01:19:11.278794 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 448/898] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:10 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1573 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:12.224118 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-2266120c-870b-49c5-b925-faaaeb6c1f4a req-a32de835-d743-4108-bdf5-f1fc5035d231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9b6064-97b6-4853-ad5c-9efefabb2f02", "name": "network-vif-plugged", "status": "completed", "tag": "97e77ecd-21bb-4202-8bef-241af78b36ab"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:12.235719 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-2266120c-870b-49c5-b925-faaaeb6c1f4a req-a32de835-d743-4108-bdf5-f1fc5035d231 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.236423 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-2266120c-870b-49c5-b925-faaaeb6c1f4a req-a32de835-d743-4108-bdf5-f1fc5035d231 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.236758 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-2266120c-870b-49c5-b925-faaaeb6c1f4a req-a32de835-d743-4108-bdf5-f1fc5035d231 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.254927 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-2266120c-870b-49c5-b925-faaaeb6c1f4a req-a32de835-d743-4108-bdf5-f1fc5035d231 service nova] Creating event network-vif-plugged:97e77ecd-21bb-4202-8bef-241af78b36ab for instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 on hv-cinder-maste Oct 30 01:19:12.261688 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-2266120c-870b-49c5-b925-faaaeb6c1f4a req-a32de835-d743-4108-bdf5-f1fc5035d231 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041099 Oct 30 01:19:12.262798 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 451/899] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:12.302424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:12.303667 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:12.303814 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:12.304649 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:12.313709 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.314207 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.314377 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.314727 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.314976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.315166 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.315924 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.316104 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.316372 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.316509 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.316798 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.317103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.568005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:12.568249 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:12.580186 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bb181ea5-b1bc-47db-bf35-2cedbe313b2b tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1573 microversion: 2.1 time: 0.281844 Oct 30 01:19:12.581080 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 452/900] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:12 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1573 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:12.583499 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6463982b-1aaa-44b5-9eb2-cc508eaafc37 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.285167 Oct 30 01:19:12.584914 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 449/901] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:12 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:13.606136 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:13.607247 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:13.613750 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:13.614797 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:13.616392 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.617061 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.617630 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:13.617837 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.618574 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.619165 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.619763 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.624278 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.633650 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.633650 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.633650 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.633650 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.634500 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.844315 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:13.850642 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:13.856523 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-03e68371-5587-4842-9a87-a1fd74ddbc67 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1573 microversion: 2.1 time: 0.254876 Oct 30 01:19:13.857581 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 453/902] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:13 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1573 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:13.860956 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-55a32001-2490-4351-8ff5-ff134c67d132 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1367 microversion: 2.1 time: 0.252791 Oct 30 01:19:13.861625 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 450/903] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:13 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:14.284680 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-a7e13796-d16a-4ef7-a370-1703c5b13a6c req-5b8b4e24-0a16-47e1-9739-1e16fcb20a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37986d61-58aa-43a7-95eb-99ab0e188914", "name": "network-vif-plugged", "status": "completed", "tag": "2787be5c-6341-4c37-abbb-ddd900bf4590"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:14.294532 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a7e13796-d16a-4ef7-a370-1703c5b13a6c req-5b8b4e24-0a16-47e1-9739-1e16fcb20a34 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.295075 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a7e13796-d16a-4ef7-a370-1703c5b13a6c req-5b8b4e24-0a16-47e1-9739-1e16fcb20a34 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.295499 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-a7e13796-d16a-4ef7-a370-1703c5b13a6c req-5b8b4e24-0a16-47e1-9739-1e16fcb20a34 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.308057 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-a7e13796-d16a-4ef7-a370-1703c5b13a6c req-5b8b4e24-0a16-47e1-9739-1e16fcb20a34 service nova] Creating event network-vif-plugged:2787be5c-6341-4c37-abbb-ddd900bf4590 for instance 37986d61-58aa-43a7-95eb-99ab0e188914 on hv-cinder-maste Oct 30 01:19:14.314101 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-a7e13796-d16a-4ef7-a370-1703c5b13a6c req-5b8b4e24-0a16-47e1-9739-1e16fcb20a34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034042 Oct 30 01:19:14.314827 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 454/904] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:14.888435 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:14.889453 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:14.890066 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:14.891211 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:14.900459 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.901268 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.901418 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.901976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.902141 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.902933 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.903140 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.903916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.904022 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.904619 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.904794 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.905425 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.114340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:15.118099 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:15.122431 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c4799c55-1bd8-489b-ad5d-0744600ed94e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1573 microversion: 2.1 time: 0.240836 Oct 30 01:19:15.123020 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 451/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:14 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1573 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:15.125947 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f639d21b-dff0-41ef-b045-3dc90a5d5626 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1557 microversion: 2.1 time: 0.243988 Oct 30 01:19:15.126637 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 455/906] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:14 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1557 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:15.148689 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:15.149091 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:15.155774 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.156270 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.156707 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.157409 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.157862 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.158366 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.245633 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7677b122-bdd3-4a26-961a-ed1dd4fd875e tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100802 Oct 30 01:19:15.246404 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 452/907] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Oct 30 01:19:15 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:16.145798 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:16.146409 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:16.149050 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:16.153796 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.154293 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.154864 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.155993 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.156449 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.156865 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.371963 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:16.385518 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ac34255c-6109-4d9f-acc1-20d92a1d0eb9 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1573 microversion: 2.1 time: 0.243571 Oct 30 01:19:16.385839 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-3012202c-e58b-436d-8aa0-8a8b33b54c98 req-e3f1788c-5c50-417d-9c7b-b4023abee115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd9b6064-97b6-4853-ad5c-9efefabb2f02", "tag": "97e77ecd-21bb-4202-8bef-241af78b36ab"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:16.386678 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 456/908] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:16 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1573 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:16.397062 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3012202c-e58b-436d-8aa0-8a8b33b54c98 req-e3f1788c-5c50-417d-9c7b-b4023abee115 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.397534 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3012202c-e58b-436d-8aa0-8a8b33b54c98 req-e3f1788c-5c50-417d-9c7b-b4023abee115 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.398171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-3012202c-e58b-436d-8aa0-8a8b33b54c98 req-e3f1788c-5c50-417d-9c7b-b4023abee115 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.410788 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-3012202c-e58b-436d-8aa0-8a8b33b54c98 req-e3f1788c-5c50-417d-9c7b-b4023abee115 service nova] Creating event network-changed:97e77ecd-21bb-4202-8bef-241af78b36ab for instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 on hv-cinder-maste Oct 30 01:19:16.415880 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-3012202c-e58b-436d-8aa0-8a8b33b54c98 req-e3f1788c-5c50-417d-9c7b-b4023abee115 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034464 Oct 30 01:19:16.416481 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 453/909] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:19:17.409604 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:17.410312 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:17.417351 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.417839 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.418271 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.419180 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.419662 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.420083 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.567704 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:17.575514 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2209d3b0-e66d-426c-814d-35677080954a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1560 microversion: 2.1 time: 0.169879 Oct 30 01:19:17.576117 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 457/910] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:17 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:41.198660 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=7 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:41.199398 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=80 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:41.203639 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:41.205917 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:41.212183 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.213377 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.213377 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.213759 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.215339 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.215339 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.245164 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1707b616-c70b-42c7-ae5d-488e7541a0c5 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048662 Oct 30 01:19:41.245826 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 454/911] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Oct 30 01:19:41 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:41.311738 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:41.312294 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:41.314462 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=3 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:41.315129 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=68 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:41.320347 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.320833 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.321268 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.322089 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.322487 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.322980 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.348697 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Going to try to terminate instance {{(pid=119523) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:19:41.690708 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-2cf4df1f-1789-4b25-a7ee-e99195108405 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 204 len: 0 microversion: 2.20 time: 0.382632 Oct 30 01:19:41.691329 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 458/912] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 30 01:19:41 2022] DELETE /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:19:41.699986 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:41.700473 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:41.707560 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.708056 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.708480 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.709153 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.709597 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.710012 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.840041 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.849126 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.850562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.851808 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ab00030c-b101-4b5b-93e0-328105fa4780 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.156194 Oct 30 01:19:41.852653 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 455/913] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:41 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:42.879054 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:42.879766 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:42.886179 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.886648 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.887075 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.887803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.888253 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.888672 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.029548 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.031140 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.033097 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.034241 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d4c34573-1a24-43b6-9d55-9f636006e452 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1724 microversion: 2.20 time: 0.159540 Oct 30 01:19:43.034795 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 459/914] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:42 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:19:44.060593 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:44.061138 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:44.068099 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.068577 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.069005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.069695 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.070133 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.070551 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.411124 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:44.420035 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:44.421485 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:44.422671 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-726a6b94-c275-48b5-945a-9f1aa09c4fff tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1656 microversion: 2.20 time: 0.366114 Oct 30 01:19:44.423230 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 456/915] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:44 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1656 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:44.529828 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-9b9bcf2a-7a73-45d9-bb14-fd29fb82b07d req-cae7cbef-e78d-4cae-9bd0-c20bc05578ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daf78ff-76d5-4869-a92a-e0b67f4721b3", "name": "network-vif-deleted", "tag": "048da4f3-1d63-47ae-b4af-333cac47dd73"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:44.541173 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-9b9bcf2a-7a73-45d9-bb14-fd29fb82b07d req-cae7cbef-e78d-4cae-9bd0-c20bc05578ab service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.541737 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-9b9bcf2a-7a73-45d9-bb14-fd29fb82b07d req-cae7cbef-e78d-4cae-9bd0-c20bc05578ab service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.542213 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-9b9bcf2a-7a73-45d9-bb14-fd29fb82b07d req-cae7cbef-e78d-4cae-9bd0-c20bc05578ab service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.560792 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-9b9bcf2a-7a73-45d9-bb14-fd29fb82b07d req-cae7cbef-e78d-4cae-9bd0-c20bc05578ab service nova] Creating event network-vif-deleted:048da4f3-1d63-47ae-b4af-333cac47dd73 for instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 on hv-cinder-maste Oct 30 01:19:44.561033 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-9b9bcf2a-7a73-45d9-bb14-fd29fb82b07d req-cae7cbef-e78d-4cae-9bd0-c20bc05578ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035062 Oct 30 01:19:44.561504 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 460/916] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:19:45.448866 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.449635 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:45.456497 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.457077 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.457585 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.458528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.459059 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.459556 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.492982 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.493597 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.494106 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.494562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.objects.instance [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lazy-loading 'fault' on Instance uuid 4daf78ff-76d5-4869-a92a-e0b67f4721b3 {{(pid=119524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:45.538664 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.547226 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.549276 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d21128dee354a04bfb008efe6b60899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74d6179e574138841007195fd72400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.550431 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3872c127-270d-4710-bc79-e4a0027fc7d1 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 200 len: 1372 microversion: 2.20 time: 0.105638 Oct 30 01:19:45.551047 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 457/917] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:45 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:46.577289 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:46.577988 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:46.584890 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.585369 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.585813 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.586508 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.586981 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.587407 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.600796 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] HTTP exception thrown: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Request method failure captured: Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 HTTP/1.1 Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc_kehOblZqvIoG-5aCfyhObHgPDaT6KnVgebMI1gVHHy2WnHUqxP_G8Rq9QDfl0HMkQVNU0fy2eBa2JKpvj7Zd-zrR_yuNvy0TdP4k45hiR0CsfcPjsv43fr1zoXU_zHCFBXEdOLUTb-KZ31Z2zIkIGwljp0OjhpvCn32cDKfoLK2g Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:19:46.602708 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e74d6179e574138841007195fd72400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e74d6179e574138841007195fd72400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 1d21128dee354a04bfb008efe6b60899 Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:46.604420 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '4daf78ff-76d5-4869-a92a-e0b67f4721b3'} Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:46.605447 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:46.607304 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:46.608906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Returning 404 to user: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:46.608906 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-01ace8e2-341f-4446-b666-efc278f880ec tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 404 len: 111 microversion: 2.20 time: 0.031637 Oct 30 01:19:46.608906 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 461/918] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:46 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:19:46.613396 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-dd5775f5-2999-4d61-b1c7-efd677f79a26 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '.version_select at 0x7f048c035ca0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:46.697067 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-dd5775f5-2999-4d61-b1c7-efd677f79a26 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984760449" status: 204 len: 0 microversion: 2.20 time: 0.087442 Oct 30 01:19:46.697670 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 458/919] 10.222.0.26 () {60 vars in 1262 bytes} [Sun Oct 30 01:19:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984760449 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:19:48.669470 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:48.670069 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:48.676945 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.677422 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.678181 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.678892 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.679343 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.679864 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.694150 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] HTTP exception thrown: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Request method failure captured: Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: DELETE /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 HTTP/1.1 Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc_kehOblZqvIoG-5aCfyhObHgPDaT6KnVgebMI1gVHHy2WnHUqxP_G8Rq9QDfl0HMkQVNU0fy2eBa2JKpvj7Zd-zrR_yuNvy0TdP4k45hiR0CsfcPjsv43fr1zoXU_zHCFBXEdOLUTb-KZ31Z2zIkIGwljp0OjhpvCn32cDKfoLK2g Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:19:48.695725 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e74d6179e574138841007195fd72400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e74d6179e574138841007195fd72400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 1d21128dee354a04bfb008efe6b60899 Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.697530 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '4daf78ff-76d5-4869-a92a-e0b67f4721b3'} Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:48.698475 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.700067 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.701757 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Returning 404 to user: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:48.701757 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-b130112e-a730-4a26-b36d-f0637418686d tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 404 len: 111 microversion: 2.20 time: 0.031592 Oct 30 01:19:48.701757 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 462/920] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 30 01:19:48 2022] DELETE /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:19:48.707083 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:48.707740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: 4daf78ff-76d5-4869-a92a-e0b67f4721b3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:48.714459 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.714939 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.715374 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.716089 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.716546 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.716968 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.730277 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] HTTP exception thrown: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Request method failure captured: Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 HTTP/1.1 Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc_kehOblZqvIoG-5aCfyhObHgPDaT6KnVgebMI1gVHHy2WnHUqxP_G8Rq9QDfl0HMkQVNU0fy2eBa2JKpvj7Zd-zrR_yuNvy0TdP4k45hiR0CsfcPjsv43fr1zoXU_zHCFBXEdOLUTb-KZ31Z2zIkIGwljp0OjhpvCn32cDKfoLK2g Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:19:48.731959 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e74d6179e574138841007195fd72400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e74d6179e574138841007195fd72400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 1d21128dee354a04bfb008efe6b60899 Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.733697 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '4daf78ff-76d5-4869-a92a-e0b67f4721b3'} Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:48.734612 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. Oct 30 01:19:48.736173 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:48.737573 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Returning 404 to user: Instance 4daf78ff-76d5-4869-a92a-e0b67f4721b3 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:48.737573 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-c870278a-52a9-4fa0-85f4-431f7089d47c tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3" status: 404 len: 111 microversion: 2.20 time: 0.031385 Oct 30 01:19:48.737573 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 459/921] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:48 2022] GET /compute/v2.1/servers/4daf78ff-76d5-4869-a92a-e0b67f4721b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:19:50.052868 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:50.053429 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:50.060540 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.061802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.061802 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.062222 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.062684 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.063106 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.077793 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] HTTP exception thrown: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Request method failure captured: Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: DELETE /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f HTTP/1.1 Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXc_kehOblZqvIoG-5aCfyhObHgPDaT6KnVgebMI1gVHHy2WnHUqxP_G8Rq9QDfl0HMkQVNU0fy2eBa2JKpvj7Zd-zrR_yuNvy0TdP4k45hiR0CsfcPjsv43fr1zoXU_zHCFBXEdOLUTb-KZ31Z2zIkIGwljp0OjhpvCn32cDKfoLK2g Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:19:50.079403 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e74d6179e574138841007195fd72400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e74d6179e574138841007195fd72400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 1d21128dee354a04bfb008efe6b60899 Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.081720 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'a61f5ece-c472-4444-b1e0-365185ebf03f'} Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:50.082578 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.083899 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.085187 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Returning 404 to user: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:50.085187 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-cb2dcba0-958d-4818-bcc0-ce21bac1dbc2 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 404 len: 111 microversion: 2.20 time: 0.032702 Oct 30 01:19:50.085187 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 463/922] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Oct 30 01:19:50 2022] DELETE /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:19:50.090331 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:50.090927 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] [instance: a61f5ece-c472-4444-b1e0-365185ebf03f] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:50.098135 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.098613 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.099042 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.099776 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.100230 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.100735 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.115122 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] HTTP exception thrown: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Request method failure captured: Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f HTTP/1.1 Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXc_kehOblZqvIoG-5aCfyhObHgPDaT6KnVgebMI1gVHHy2WnHUqxP_G8Rq9QDfl0HMkQVNU0fy2eBa2JKpvj7Zd-zrR_yuNvy0TdP4k45hiR0CsfcPjsv43fr1zoXU_zHCFBXEdOLUTb-KZ31Z2zIkIGwljp0OjhpvCn32cDKfoLK2g Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:19:50.116682 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e74d6179e574138841007195fd72400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e74d6179e574138841007195fd72400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e74d6179e574138841007195fd72400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 6e74d6179e574138841007195fd72400 Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-835988946 Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 1d21128dee354a04bfb008efe6b60899 Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-835988946-project Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.118435 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'a61f5ece-c472-4444-b1e0-365185ebf03f'} Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:50.119471 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. Oct 30 01:19:50.121077 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:19:50.122567 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] Returning 404 to user: Instance a61f5ece-c472-4444-b1e0-365185ebf03f could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:50.122567 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-ec48f5d1-0794-4f07-b1e6-f9d465622826 tempest-AttachVolumeShelveTestJSON-835988946 tempest-AttachVolumeShelveTestJSON-835988946-project] 10.222.0.26 "GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f" status: 404 len: 111 microversion: 2.20 time: 0.031731 Oct 30 01:19:50.122567 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 460/923] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:50 2022] GET /compute/v2.1/servers/a61f5ece-c472-4444-b1e0-365185ebf03f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:19:52.706936 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:52.708023 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:52.714312 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.715006 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.715645 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.716655 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.717309 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.717928 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.755266 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0ee807b9-f094-4319-b76b-1f183d566a8f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/ips" status: 200 len: 149 microversion: 2.1 time: 0.052544 Oct 30 01:19:52.762328 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 464/924] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:19:52 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:54.395063 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2728ce1f-fc75-4a1f-89b5-98c6e9d0453d"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:54.397466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:54.406488 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:54.407148 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:54.407521 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:54.408372 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:54.408830 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:54.409258 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.408874 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-eceace09-c093-45cb-bfcb-848fe9fc369d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "POST /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.018285 Oct 30 01:19:55.409568 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 461/925] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Oct 30 01:19:54 2022] POST /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments => generated 194 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:57.800752 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:57.801324 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:57.808380 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.808875 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.809309 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.810025 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.810500 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.810920 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.911162 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lazy-loading 'services' on Instance uuid cd9b6064-97b6-4853-ad5c-9efefabb2f02 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:58.187223 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-80973ff8-f200-42c2-8d38-9a973f2d442d tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments/2728ce1f-fc75-4a1f-89b5-98c6e9d0453d" status: 202 len: 0 microversion: 2.1 time: 0.390330 Oct 30 01:19:58.187766 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 465/926] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Oct 30 01:19:57 2022] DELETE /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments/2728ce1f-fc75-4a1f-89b5-98c6e9d0453d => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:19:58.198167 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:58.200532 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:58.207014 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.207502 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.208104 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.208836 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.209291 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.209716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.240488 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0c3870ce-640a-409a-800b-7eea8394fd68 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047903 Oct 30 01:19:58.241073 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 462/927] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:19:58 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:59.254325 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.256733 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.263668 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.264162 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.264593 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.265407 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.265864 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.266286 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.297694 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a29b6280-642f-4721-82d1-71d020f081d4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047843 Oct 30 01:19:59.298239 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 466/928] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Oct 30 01:19:59 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:19:59.366186 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.366683 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.373170 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.373653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.374081 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.374771 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.375223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.375673 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.402243 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:19:59.758863 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-532adf9e-f331-49e8-8054-6900e1de979c tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 204 len: 0 microversion: 2.1 time: 0.396753 Oct 30 01:19:59.759379 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 463/929] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:19:59 2022] DELETE /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:59.767554 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.768248 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.774633 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.778974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.778974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.778974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.778974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.779375 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.911579 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.919462 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-74bffa8a-09fc-400f-bbe0-d2cd9b334fa4 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1681 microversion: 2.1 time: 0.155705 Oct 30 01:19:59.920060 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 467/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:59 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:20:00.944441 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:00.945346 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:00.951983 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:00.955707 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:00.955707 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:00.955707 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:00.955707 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:00.956113 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:01.085886 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.093626 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-25c4b8d0-0618-4323-b463-38db4261fd40 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1681 microversion: 2.1 time: 0.153687 Oct 30 01:20:01.094178 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 464/931] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:00 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:02.118525 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:02.119286 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:02.128103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:02.128103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:02.128103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:02.128103 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:02.128562 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:02.128986 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:02.224681 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:02.233483 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fe349d3b-9d5a-4bc5-a5e0-322c5a8e88b6 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1614 microversion: 2.1 time: 0.119520 Oct 30 01:20:02.234055 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 468/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:02 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:20:02.641143 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-33a34466-ddb8-430c-ad74-e17ca90e2df5 req-6560abd7-6e15-4fb8-b3e6-3c57142a53a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9b6064-97b6-4853-ad5c-9efefabb2f02", "name": "network-vif-deleted", "tag": "97e77ecd-21bb-4202-8bef-241af78b36ab"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:02.650991 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-33a34466-ddb8-430c-ad74-e17ca90e2df5 req-6560abd7-6e15-4fb8-b3e6-3c57142a53a5 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:02.651774 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-33a34466-ddb8-430c-ad74-e17ca90e2df5 req-6560abd7-6e15-4fb8-b3e6-3c57142a53a5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:02.652526 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-33a34466-ddb8-430c-ad74-e17ca90e2df5 req-6560abd7-6e15-4fb8-b3e6-3c57142a53a5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:02.676560 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-33a34466-ddb8-430c-ad74-e17ca90e2df5 req-6560abd7-6e15-4fb8-b3e6-3c57142a53a5 service nova] Creating event network-vif-deleted:97e77ecd-21bb-4202-8bef-241af78b36ab for instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 on hv-cinder-maste Oct 30 01:20:02.682451 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-33a34466-ddb8-430c-ad74-e17ca90e2df5 req-6560abd7-6e15-4fb8-b3e6-3c57142a53a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231637 Oct 30 01:20:02.683315 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 465/933] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:03.257579 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:03.258233 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:03.266436 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:03.267101 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:03.267803 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:03.268595 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:03.269208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:03.269708 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:03.309678 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:03.310269 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:03.310855 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:03.311380 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lazy-loading 'fault' on Instance uuid cd9b6064-97b6-4853-ad5c-9efefabb2f02 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:03.376324 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09696979ec94a2699d7cb1e2aa77a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd37394129e346a8804d667856309041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:03.392106 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-8b9995b8-9706-491a-abe2-b26d02dbc935 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 200 len: 1332 microversion: 2.1 time: 0.138423 Oct 30 01:20:03.393269 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 469/934] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:03 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:04.425874 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:04.426584 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:04.433736 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.434229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.434669 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.435374 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.435857 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.436342 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.450529 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 HTTP/1.1 Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:04.452229 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:04.454363 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'cd9b6064-97b6-4853-ad5c-9efefabb2f02'} Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:04.456098 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:04.458056 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:04.459848 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:04.459848 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b0f39689-8974-4fa1-8fdc-61be19517e87 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 404 len: 111 microversion: 2.1 time: 0.032675 Oct 30 01:20:04.459848 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 466/935] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:04 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:04.464551 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-0b935d51-cbd7-4660-ac27-a54c97b5f432 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '.version_select at 0x7f0487e5e3a0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:04.560614 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-0b935d51-cbd7-4660-ac27-a54c97b5f432 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969361371" status: 202 len: 0 microversion: 2.1 time: 0.099589 Oct 30 01:20:04.561340 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 470/936] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Oct 30 01:20:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969361371 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:20:06.894243 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:06.894721 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:06.901235 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.901716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.902155 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.902880 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.903342 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.903805 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.920157 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: DELETE /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 HTTP/1.1 Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:06.921639 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.923252 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'cd9b6064-97b6-4853-ad5c-9efefabb2f02'} Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:06.924308 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.925818 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.927342 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:06.927342 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-50d275a0-8de5-4e5d-a075-ba1b26fc6a73 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 404 len: 111 microversion: 2.1 time: 0.032771 Oct 30 01:20:06.927342 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 467/937] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:06 2022] DELETE /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:06.932929 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:06.933617 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: cd9b6064-97b6-4853-ad5c-9efefabb2f02] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:06.940297 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.946957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.946957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.946957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.946957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.947341 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.955694 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 HTTP/1.1 Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:20:06.957313 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.958952 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'cd9b6064-97b6-4853-ad5c-9efefabb2f02'} Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:06.959874 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. Oct 30 01:20:06.961939 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:06.963266 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance cd9b6064-97b6-4853-ad5c-9efefabb2f02 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:06.963266 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d760dfa4-22f5-4461-84ad-f4ad22cdf2bf tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02" status: 404 len: 111 microversion: 2.1 time: 0.030818 Oct 30 01:20:06.963266 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 471/938] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:06 2022] GET /compute/v2.1/servers/cd9b6064-97b6-4853-ad5c-9efefabb2f02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:08.270909 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:08.271458 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:08.278530 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.279069 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.279454 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.280179 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.280640 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.281173 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.294658 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: DELETE /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a HTTP/1.1 Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:08.296230 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.298003 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '7cdeab19-9694-47d7-b99e-f9f2e77a521a'} Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:08.299043 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.300455 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.302331 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:08.302331 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e0702087-d2ba-4d03-8203-e9ff07a68c47 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 404 len: 111 microversion: 2.1 time: 0.030619 Oct 30 01:20:08.302331 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 468/939] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:08 2022] DELETE /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:08.306975 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:08.307478 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: 7cdeab19-9694-47d7-b99e-f9f2e77a521a] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:08.313937 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.314410 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.314832 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.315509 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.315982 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.316395 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.330159 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a HTTP/1.1 Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:20:08.331709 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.333430 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '7cdeab19-9694-47d7-b99e-f9f2e77a521a'} Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:08.334629 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. Oct 30 01:20:08.336197 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.338208 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance 7cdeab19-9694-47d7-b99e-f9f2e77a521a could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:08.338208 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-17b29b86-bf03-4763-9d37-620e504ca214 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a" status: 404 len: 111 microversion: 2.1 time: 0.030182 Oct 30 01:20:08.338208 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 472/940] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:08 2022] GET /compute/v2.1/servers/7cdeab19-9694-47d7-b99e-f9f2e77a521a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:08.342716 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:08.351528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:08.351528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.351528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.351528 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.351960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.351960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.351960 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.367643 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: DELETE /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 HTTP/1.1 Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:08.369140 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.370796 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'b158f22f-4875-4dd7-9079-58e4dc91e7a3'} Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:08.371887 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.373374 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.375345 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:08.375345 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b24232ca-0930-4e08-a24e-da7d967b6957 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 404 len: 111 microversion: 2.1 time: 0.031732 Oct 30 01:20:08.375345 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 469/941] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:08 2022] DELETE /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:08.379119 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:08.379756 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: b158f22f-4875-4dd7-9079-58e4dc91e7a3] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:08.386253 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.386730 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.387161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.395687 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.395687 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.395687 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.404507 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 HTTP/1.1 Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:20:08.406001 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.407746 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'b158f22f-4875-4dd7-9079-58e4dc91e7a3'} Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:08.408831 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. Oct 30 01:20:08.410324 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:08.412019 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance b158f22f-4875-4dd7-9079-58e4dc91e7a3 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:08.412019 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bfbe9f88-0cdc-4f10-bec5-4ec6ac821dd8 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3" status: 404 len: 111 microversion: 2.1 time: 0.032284 Oct 30 01:20:08.412019 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 473/942] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:08 2022] GET /compute/v2.1/servers/b158f22f-4875-4dd7-9079-58e4dc91e7a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:09.724566 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:09.725065 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:09.731830 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.732317 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.732749 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.733466 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.733916 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.734340 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.748407 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: DELETE /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 HTTP/1.1 Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:09.749815 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.751372 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'bc02e945-abfb-4689-b7b1-753df25b5f53'} Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:09.752336 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.753805 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.755335 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:09.755335 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-aaa606df-c5fe-4cd8-a9f6-e173b879e299 tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 404 len: 111 microversion: 2.1 time: 0.030895 Oct 30 01:20:09.755335 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 470/943] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:09 2022] DELETE /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:09.761161 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:09.761759 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] [instance: bc02e945-abfb-4689-b7b1-753df25b5f53] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:09.768109 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.768583 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.769005 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.769685 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.770131 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.770546 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.786144 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] HTTP exception thrown: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Request method failure captured: Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 HTTP/1.1 Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdAeCYgsnhnDJfomOKr805R1YLEaA4OQ3I80R1mVOzwadINxIwd1kz9op1QxlYDHtVgkSDGfMYqreZ-wvGweT11odX3w-HLmcgxKf2Jg8Ym92bpGfGDD8B-rlsOtshdtTXuuMQVz_u3Lrd5-nqEKL4ydMSftfuF5CUP5tCR04cY0RoE Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:20:09.787713 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd37394129e346a8804d667856309041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd37394129e346a8804d667856309041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd37394129e346a8804d667856309041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: cd37394129e346a8804d667856309041 Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1879461949 Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: d09696979ec94a2699d7cb1e2aa77a64 Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-AttachVolumeNegativeTest-1879461949-project Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.789333 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': 'bc02e945-abfb-4689-b7b1-753df25b5f53'} Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:09.790238 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. Oct 30 01:20:09.791754 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:09.793083 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] Returning 404 to user: Instance bc02e945-abfb-4689-b7b1-753df25b5f53 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:09.793083 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7265b8c0-9839-41ba-b25f-ef89244d6d7f tempest-AttachVolumeNegativeTest-1879461949 tempest-AttachVolumeNegativeTest-1879461949-project] 10.222.0.26 "GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53" status: 404 len: 111 microversion: 2.1 time: 0.032337 Oct 30 01:20:09.793083 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 474/944] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:09 2022] GET /compute/v2.1/servers/bc02e945-abfb-4689-b7b1-753df25b5f53 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:15.672854 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-80251166-7dbc-40e6-a68a-ae0ce11efa36 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Action: 'create', calling method: .version_select at 0x7f048c04d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1380970702"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:16.530849 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-80251166-7dbc-40e6-a68a-ae0ce11efa36 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.976223 Oct 30 01:20:16.531511 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 471/945] 10.222.0.26 () {60 vars in 1155 bytes} [Sun Oct 30 01:20:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 978 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 30 01:20:16.545270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1054c6fc-7e12-4c0d-8d4f-1f2a5a47ccd4 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487d675e0>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:16.593891 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1054c6fc-7e12-4c0d-8d4f-1f2a5a47ccd4 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca" status: 200 len: 345 microversion: 2.1 time: 0.052446 Oct 30 01:20:16.594454 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 475/946] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:20:16 2022] GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:17.608777 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-1adec920-c131-4900-b8e0-a9f71ed84e78 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487f75670>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:17.657531 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-1adec920-c131-4900-b8e0-a9f71ed84e78 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca" status: 200 len: 346 microversion: 2.1 time: 0.053205 Oct 30 01:20:17.658102 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 472/947] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:20:17 2022] GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:17.671608 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-d6153f1a-6589-41dd-9c78-43fcf044cd59 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Action: 'create', calling method: .version_select at 0x7f0487eb0790>, body: {"snapshot": {"volume_id": "672038dc-b6be-41eb-a89e-95c3890474ca", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1698798641"}} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:18.126870 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-d6153f1a-6589-41dd-9c78-43fcf044cd59 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.459526 Oct 30 01:20:18.127550 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 476/948] 10.222.0.26 () {60 vars in 1162 bytes} [Sun Oct 30 01:20:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:18.139310 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-9dfe28cf-f97e-4352-8fb6-4b86cc40034d tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487ecf0d0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:18.168619 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-9dfe28cf-f97e-4352-8fb6-4b86cc40034d tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d" status: 200 len: 287 microversion: 2.1 time: 0.033837 Oct 30 01:20:18.169184 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 473/949] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 30 01:20:18 2022] GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:18.179731 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-fe9c698e-a98a-476c-bdaa-88fb07cfd8de tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487d25f70>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:18.211635 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-fe9c698e-a98a-476c-bdaa-88fb07cfd8de tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035552 Oct 30 01:20:18.212201 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 477/950] 10.222.0.26 () {58 vars in 1140 bytes} [Sun Oct 30 01:20:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:18.223467 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-2aa616e6-4fc8-4929-97d0-0e3209c0fb7d tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487d69af0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:18.255379 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-2aa616e6-4fc8-4929-97d0-0e3209c0fb7d tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d" status: 200 len: 287 microversion: 2.1 time: 0.035803 Oct 30 01:20:18.255976 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 474/951] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 30 01:20:18 2022] GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:19.269853 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-7fd7da2b-82f5-4165-9d59-148c9072db1c tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487cfad30>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:19.299902 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-7fd7da2b-82f5-4165-9d59-148c9072db1c tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d" status: 200 len: 288 microversion: 2.1 time: 0.034328 Oct 30 01:20:19.300516 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 478/952] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 30 01:20:19 2022] GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:19.312177 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-eb571ce6-e6f1-43d2-9e1c-65a23a735939 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f048c1d49d0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:19.433453 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-eb571ce6-e6f1-43d2-9e1c-65a23a735939 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d" status: 202 len: 0 microversion: 2.1 time: 0.125488 Oct 30 01:20:19.434029 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 475/953] 10.222.0.26 () {58 vars in 1254 bytes} [Sun Oct 30 01:20:19 2022] DELETE /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:20:19.442407 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-348fbffa-593f-4ab9-ac4d-3e80c0c1e082 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487f24e50>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:19.474673 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-348fbffa-593f-4ab9-ac4d-3e80c0c1e082 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d" status: 200 len: 287 microversion: 2.1 time: 0.036041 Oct 30 01:20:19.475334 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 479/954] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 30 01:20:19 2022] GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:20.485010 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:20.485863 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:20.490505 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e9c1cdab-7ec8-4a9b-b8ac-f190de0a3a00 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f048c1d48b0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-e9c1cdab-7ec8-4a9b-b8ac-f190de0a3a00 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] HTTP exception thrown: Snapshot eac67faa-69ca-40e1-84ba-542967962d9d could not be found. Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e9c1cdab-7ec8-4a9b-b8ac-f190de0a3a00 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Request method failure captured: Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d HTTP/1.1 Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdFPPOp_EoSDOzGY-tmjpFw4cGP8DEUXlDdpqMIbE0jV5OinBzB7rxlnqOKChRBK8nSy_22XIoYf-vwRtOgc82EYShOmskMzLzwYnRfsBmyAkAnGsLrWgSOZIqPXmeDT_soX9Ch1swubAGtAlqaNYrwt50OZsLnzSobxu2b6LYQJxao Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:20.519841 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 0a98ada8957c407583a39423e4c11bbc Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Snapshot eac67faa-69ca-40e1-84ba-542967962d9d could not be found. Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': 'eac67faa-69ca-40e1-84ba-542967962d9d'} Oct 30 01:20:20.521561 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eac67faa-69ca-40e1-84ba-542967962d9d could not be found. (HTTP 404) (Request-ID: req-b9fbe8ba-cfd8-41c4-8b35-5cc837827063) Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:20.522725 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:20:20.524167 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eac67faa-69ca-40e1-84ba-542967962d9d could not be found. Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 30 01:20:20.525804 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eac67faa-69ca-40e1-84ba-542967962d9d could not be found. Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eac67faa-69ca-40e1-84ba-542967962d9d could not be found. Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e9c1cdab-7ec8-4a9b-b8ac-f190de0a3a00 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Returning 404 to user: Snapshot eac67faa-69ca-40e1-84ba-542967962d9d could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:20.527463 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e9c1cdab-7ec8-4a9b-b8ac-f190de0a3a00 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d" status: 404 len: 111 microversion: 2.1 time: 0.036401 Oct 30 01:20:20.528659 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 476/955] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Oct 30 01:20:20 2022] GET /compute/v2.1/os-snapshots/eac67faa-69ca-40e1-84ba-542967962d9d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:20.528771 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:20.528771 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:20.531790 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-f7242765-903e-4f7a-b7c0-ea7db6b35128 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487c9c700>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:20.799142 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-f7242765-903e-4f7a-b7c0-ea7db6b35128 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca" status: 202 len: 0 microversion: 2.1 time: 0.273322 Oct 30 01:20:20.799743 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 480/956] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:20:20 2022] DELETE /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:20:20.809030 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-207436e4-c084-4546-959b-9ffe5e9f9b3d tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487f3ddc0>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:20.858242 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-207436e4-c084-4546-959b-9ffe5e9f9b3d tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca" status: 200 len: 345 microversion: 2.1 time: 0.053824 Oct 30 01:20:20.858707 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 477/957] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:20:20 2022] GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:21.874137 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bcc7dd11-7a9f-48a0-a340-e7b5d568cc92 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487f24430>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:21.902805 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-bcc7dd11-7a9f-48a0-a340-e7b5d568cc92 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] HTTP exception thrown: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bcc7dd11-7a9f-48a0-a340-e7b5d568cc92 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Request method failure captured: Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca HTTP/1.1 Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdFPPOp_EoSDOzGY-tmjpFw4cGP8DEUXlDdpqMIbE0jV5OinBzB7rxlnqOKChRBK8nSy_22XIoYf-vwRtOgc82EYShOmskMzLzwYnRfsBmyAkAnGsLrWgSOZIqPXmeDT_soX9Ch1swubAGtAlqaNYrwt50OZsLnzSobxu2b6LYQJxao Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:20:21.904801 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 0a98ada8957c407583a39423e4c11bbc Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '672038dc-b6be-41eb-a89e-95c3890474ca'} Oct 30 01:20:21.910210 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. (HTTP 404) (Request-ID: req-14ef3c7a-5d96-4ad1-87f0-4bd67bdb33e7) Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:21.911328 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:20:21.912674 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:20:21.913916 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-bcc7dd11-7a9f-48a0-a340-e7b5d568cc92 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Returning 404 to user: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-bcc7dd11-7a9f-48a0-a340-e7b5d568cc92 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca" status: 404 len: 109 microversion: 2.1 time: 0.037354 Oct 30 01:20:21.915156 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 481/958] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:20:21 2022] GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:21.922338 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e2828121-a8a4-4ed7-a119-3a5027393936 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f048c0b4700>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:21.954427 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-e2828121-a8a4-4ed7-a119-3a5027393936 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] HTTP exception thrown: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e2828121-a8a4-4ed7-a119-3a5027393936 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Request method failure captured: Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: DELETE /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca HTTP/1.1 Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdFPPOp_EoSDOzGY-tmjpFw4cGP8DEUXlDdpqMIbE0jV5OinBzB7rxlnqOKChRBK8nSy_22XIoYf-vwRtOgc82EYShOmskMzLzwYnRfsBmyAkAnGsLrWgSOZIqPXmeDT_soX9Ch1swubAGtAlqaNYrwt50OZsLnzSobxu2b6LYQJxao Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:21.956489 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 0a98ada8957c407583a39423e4c11bbc Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '672038dc-b6be-41eb-a89e-95c3890474ca'} Oct 30 01:20:21.958116 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. (HTTP 404) (Request-ID: req-0eecf82e-7bdb-49f1-9f14-1c7a5f480761) Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:21.959004 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:20:21.960281 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 01:20:21.961498 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-e2828121-a8a4-4ed7-a119-3a5027393936 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Returning 404 to user: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-e2828121-a8a4-4ed7-a119-3a5027393936 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca" status: 404 len: 109 microversion: 2.1 time: 0.040221 Oct 30 01:20:21.962718 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 478/959] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Oct 30 01:20:21 2022] DELETE /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:21.967309 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3e71bb8a-031a-492e-a63e-e9526ecade05 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Calling method '.version_select at 0x7f0487d67280>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:21.996560 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-3e71bb8a-031a-492e-a63e-e9526ecade05 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] HTTP exception thrown: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3e71bb8a-031a-492e-a63e-e9526ecade05 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Request method failure captured: Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca HTTP/1.1 Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdFPPOp_EoSDOzGY-tmjpFw4cGP8DEUXlDdpqMIbE0jV5OinBzB7rxlnqOKChRBK8nSy_22XIoYf-vwRtOgc82EYShOmskMzLzwYnRfsBmyAkAnGsLrWgSOZIqPXmeDT_soX9Ch1swubAGtAlqaNYrwt50OZsLnzSobxu2b6LYQJxao Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:20:21.998496 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff5adf813db14e478b171abbd8ba07a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: ff5adf813db14e478b171abbd8ba07a7 Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520834476 Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: 0a98ada8957c407583a39423e4c11bbc Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520834476-project Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '672038dc-b6be-41eb-a89e-95c3890474ca'} Oct 30 01:20:22.000013 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. (HTTP 404) (Request-ID: req-0d3af2b5-7132-40da-b606-ab74356d586f) Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:22.000849 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:20:22.002093 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:20:22.003273 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-3e71bb8a-031a-492e-a63e-e9526ecade05 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] Returning 404 to user: Volume 672038dc-b6be-41eb-a89e-95c3890474ca could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-3e71bb8a-031a-492e-a63e-e9526ecade05 tempest-VolumesSnapshotsTestJSON-1520834476 tempest-VolumesSnapshotsTestJSON-1520834476-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca" status: 404 len: 109 microversion: 2.1 time: 0.036942 Oct 30 01:20:22.004928 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 482/960] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Oct 30 01:20:21 2022] GET /compute/v2.1/os-volumes/672038dc-b6be-41eb-a89e-95c3890474ca => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:37.638842 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:37.639457 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:37.647218 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:37.647740 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:37.648439 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:37.649584 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:37.650278 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:37.650944 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:37.682373 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:20:37.870967 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-bbe9a43b-c81e-4cf3-858e-f7ef57720d5b req-13adcef8-4a39-488c-a441-bc7cd9b367cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37986d61-58aa-43a7-95eb-99ab0e188914", "tag": "2787be5c-6341-4c37-abbb-ddd900bf4590"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:37.883830 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-bbe9a43b-c81e-4cf3-858e-f7ef57720d5b req-13adcef8-4a39-488c-a441-bc7cd9b367cf service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:37.887741 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-bbe9a43b-c81e-4cf3-858e-f7ef57720d5b req-13adcef8-4a39-488c-a441-bc7cd9b367cf service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:37.887741 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-bbe9a43b-c81e-4cf3-858e-f7ef57720d5b req-13adcef8-4a39-488c-a441-bc7cd9b367cf service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:37.897614 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-bbe9a43b-c81e-4cf3-858e-f7ef57720d5b req-13adcef8-4a39-488c-a441-bc7cd9b367cf service nova] Creating event network-changed:2787be5c-6341-4c37-abbb-ddd900bf4590 for instance 37986d61-58aa-43a7-95eb-99ab0e188914 on hv-cinder-maste Oct 30 01:20:37.903567 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-bbe9a43b-c81e-4cf3-858e-f7ef57720d5b req-13adcef8-4a39-488c-a441-bc7cd9b367cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267256 Oct 30 01:20:37.904446 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 483/961] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:20:38.028362 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3864051e-2bfd-4b6c-8018-785a4764b01e tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "DELETE /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 204 len: 0 microversion: 2.1 time: 0.394301 Oct 30 01:20:38.030593 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 479/962] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:37 2022] DELETE /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:38.053405 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:38.060169 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:38.087946 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:38.093231 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:38.095797 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:38.097762 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:38.099409 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:38.101043 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:38.315307 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:38.323794 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-a2367ea3-8768-4d0d-a609-daceac0136c0 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.288357 Oct 30 01:20:38.324464 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 484/963] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:38 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:39.350319 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:39.351030 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:39.358232 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:39.358804 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:39.359958 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:39.360915 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:39.361373 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:39.361800 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:39.634748 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:39.644317 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-651b32d9-7cc1-4701-a761-b86d14f3771a tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1566 microversion: 2.1 time: 0.298663 Oct 30 01:20:39.644898 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 480/964] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:39 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1566 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:40.347951 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-5851439a-419e-43ff-81e5-5469fdf73750 req-39953914-fe63-46b2-ab95-8c62f2f1c386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37986d61-58aa-43a7-95eb-99ab0e188914", "name": "network-vif-deleted", "tag": "2787be5c-6341-4c37-abbb-ddd900bf4590"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:40.359749 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-5851439a-419e-43ff-81e5-5469fdf73750 req-39953914-fe63-46b2-ab95-8c62f2f1c386 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:40.360507 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-5851439a-419e-43ff-81e5-5469fdf73750 req-39953914-fe63-46b2-ab95-8c62f2f1c386 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:40.360930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-5851439a-419e-43ff-81e5-5469fdf73750 req-39953914-fe63-46b2-ab95-8c62f2f1c386 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:40.373408 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-5851439a-419e-43ff-81e5-5469fdf73750 req-39953914-fe63-46b2-ab95-8c62f2f1c386 service nova] Creating event network-vif-deleted:2787be5c-6341-4c37-abbb-ddd900bf4590 for instance 37986d61-58aa-43a7-95eb-99ab0e188914 on hv-cinder-maste Oct 30 01:20:40.379112 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-5851439a-419e-43ff-81e5-5469fdf73750 req-39953914-fe63-46b2-ab95-8c62f2f1c386 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034839 Oct 30 01:20:40.379734 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 485/965] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:40.683292 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:40.683931 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:40.692182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:40.692988 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:40.693419 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:40.694116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:40.694562 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:40.694976 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:40.795324 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:40.806155 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-03ce01dc-fb3f-40e8-bb5b-0ad180dd49ac tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1219 microversion: 2.1 time: 0.130275 Oct 30 01:20:40.806736 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 481/966] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:40 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:41.833470 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:41.840035 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:41.845426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.846828 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.847333 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.848270 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.848887 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.850547 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.908790 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.910553 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.910553 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.911125 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.objects.instance [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lazy-loading 'fault' on Instance uuid 37986d61-58aa-43a7-95eb-99ab0e188914 {{(pid=119523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:41.972337 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af60a16a7c24542b5b8aa94d2bfe9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f0064a8bc14f30b2749047dfd2f53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:41.980877 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-eb511de7-5bd9-4d21-bd60-16ae02b786d2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 200 len: 1224 microversion: 2.1 time: 0.153264 Oct 30 01:20:41.981722 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 486/967] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:41 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:43.006486 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:43.007175 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] [instance: 37986d61-58aa-43a7-95eb-99ab0e188914] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:43.013744 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.014223 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.014653 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.016182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.016637 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.017051 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.033286 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.wsgi [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] HTTP exception thrown: Instance 37986d61-58aa-43a7-95eb-99ab0e188914 could not be found. Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Request method failure captured: Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: request: GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 HTTP/1.1 Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept: application/json Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Accept-Encoding: identity Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Connection: close Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Length: 0 Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Content-Type: application/json Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Host: 10.222.0.26 Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: Openstack-System-Scope: None Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Auth-Token: gAAAAABjXdBIZksATw_ITsmkdx2LGaM08r6675gB84RTZsuDnAHR32XZ8BrpufQP5ivCmZFw6AF0Qbjub6wJemkceTuUncGliWOTXZo0lOfG59coHHSWoM40Hz50_JUW4MTSPSgYcRRo3uQFxaAwp9C9MQkVPONVvibwXDrc5KfYF3XsQmDxM3E Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Id: None Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Domain-Name: None Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Identity-Status: Confirmed Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Is-Admin-Project: True Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Id: default Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Domain-Name: Default Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Id: 55f0064a8bc14f30b2749047dfd2f53d Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Project-Name: tempest-TestShelveInstance-967775632 Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Role: reader,member Oct 30 01:20:43.034937 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Roles: reader,member Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f0064a8bc14f30b2749047dfd2f53d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55f0064a8bc14f30b2749047dfd2f53d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f0064a8bc14f30b2749047dfd2f53d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55f0064a8bc14f30b2749047dfd2f53d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant: tempest-TestShelveInstance-967775632 Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Id: 55f0064a8bc14f30b2749047dfd2f53d Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-Tenant-Name: tempest-TestShelveInstance-967775632 Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User: tempest-TestShelveInstance-967775632-project Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Id: default Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Domain-Name: Default Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Id: 4af60a16a7c24542b5b8aa94d2bfe9ef Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: X-User-Name: tempest-TestShelveInstance-967775632-project Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: method: > Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: exception: Instance 37986d61-58aa-43a7-95eb-99ab0e188914 could not be found. Oct 30 01:20:43.036722 dv-cinder-master-3-smb devstack@n-api.service[119524]: action_args: {'id': '37986d61-58aa-43a7-95eb-99ab0e188914'} Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37986d61-58aa-43a7-95eb-99ab0e188914 could not be found. Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:43.037671 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37986d61-58aa-43a7-95eb-99ab0e188914 could not be found. Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37986d61-58aa-43a7-95eb-99ab0e188914 could not be found. Oct 30 01:20:43.039049 dv-cinder-master-3-smb devstack@n-api.service[119524]: ERROR nova.api.openstack.wsgi Oct 30 01:20:43.040993 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Returning 404 to user: Instance 37986d61-58aa-43a7-95eb-99ab0e188914 could not be found. {{(pid=119524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:43.041930 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b2b6e2fa-2490-4aca-9494-70a71fbe68a2 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914" status: 404 len: 111 microversion: 2.1 time: 0.039313 Oct 30 01:20:43.042498 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 482/968] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:43 2022] GET /compute/v2.1/servers/37986d61-58aa-43a7-95eb-99ab0e188914 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:43.320359 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-06759989-fb2f-44af-82eb-19ee8b4b8e13 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] Calling method '.version_select at 0x7f0487ed7b80>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:43.426644 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-06759989-fb2f-44af-82eb-19ee8b4b8e13 tempest-TestShelveInstance-967775632 tempest-TestShelveInstance-967775632-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1317867039" status: 202 len: 0 microversion: 2.1 time: 0.111731 Oct 30 01:20:43.427247 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 487/969] 10.222.0.26 () {58 vars in 1254 bytes} [Sun Oct 30 01:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1317867039 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:21:00.197872 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-494521684", "imageRef": "d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b", "flavorRef": "452"}} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:00.205954 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:00.206597 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:00.254785 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.network.neutron [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] validate_networks() for None {{(pid=119524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:21:00.536527 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Flavor limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:21:00.537100 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Image limits 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:21:00.537606 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Flavor pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:21:00.538005 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Image pref 0:0:0 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:21:00.538413 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.virt.hardware [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:21:00.547376 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.547892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.548321 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.549043 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.549494 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.549911 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.566618 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Getting quotas for project 5fc5163150b440ebb6e60097378e2274. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:21:00.570825 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.quota [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Getting quotas for user b62335db37664c68802042ff7c22fc33 and project 5fc5163150b440ebb6e60097378e2274. Resources: {'cores', 'instances', 'ram'} {{(pid=119524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:21:00.583491 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Going to run 1 instances... {{(pid=119524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:21:00.585850 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d61cfcb4-4c69-4cf0-b68c-e5d1b8f0cb1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:21:00.950339 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0373aff3-6cd6-42d8-bf43-691110a13967 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756259 Oct 30 01:21:00.951192 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 483/970] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Oct 30 01:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:21:00.960426 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell1:SELECT=18 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:00.961189 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:00.965101 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-59f89741-3c1c-4704-a608-a701b375c5c6 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:00.966012 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-59f89741-3c1c-4704-a608-a701b375c5c6 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:01.032716 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-59f89741-3c1c-4704-a608-a701b375c5c6 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:01.042280 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-59f89741-3c1c-4704-a608-a701b375c5c6 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1214 microversion: 2.1 time: 0.083261 Oct 30 01:21:01.042908 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 488/971] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:00 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:02.066731 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-7f917f5a-dffd-44a3-8640-d51bf46065c4 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:02.067342 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-7f917f5a-dffd-44a3-8640-d51bf46065c4 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:02.122785 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-7f917f5a-dffd-44a3-8640-d51bf46065c4 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:02.130562 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-7f917f5a-dffd-44a3-8640-d51bf46065c4 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1214 microversion: 2.1 time: 0.068370 Oct 30 01:21:02.131111 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 484/972] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:02 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:03.154939 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:03.155548 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:03.170259 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.170751 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.171189 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.172764 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.173230 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.173667 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.247874 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:03.257365 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-04cc3a6f-a69e-407d-9798-a4668e7e434f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1266 microversion: 2.1 time: 0.106156 Oct 30 01:21:03.257971 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 489/973] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:03 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:04.281277 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:04.281892 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:04.289169 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:04.292436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:04.292436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:04.292436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:04.292436 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:04.293079 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:04.356752 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:04.369070 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-07830536-b484-4cf1-8be8-ef4e056d301f tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1272 microversion: 2.1 time: 0.089349 Oct 30 01:21:04.369070 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 485/974] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:04 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:05.391905 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:05.392900 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:05.401767 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:05.402482 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:05.403262 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:05.404063 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:05.404719 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:05.405329 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:05.587593 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:05.595439 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9e68eccb-1cb1-490a-b876-ca2b5afc826c tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.207513 Oct 30 01:21:05.596045 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 490/975] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:05 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:06.071374 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [req-5e1c8ffc-ee74-4ab9-b51a-84a7915d80ef req-259e7500-5e14-43cc-b745-35d30b30ddc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745a7875-3650-44fe-bdc7-5d9be2202641", "tag": "3d6e600d-e074-446d-9be0-9d94d8296f2e"}]} {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:06.083779 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-5e1c8ffc-ee74-4ab9-b51a-84a7915d80ef req-259e7500-5e14-43cc-b745-35d30b30ddc5 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:06.084370 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-5e1c8ffc-ee74-4ab9-b51a-84a7915d80ef req-259e7500-5e14-43cc-b745-35d30b30ddc5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:06.084961 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [req-5e1c8ffc-ee74-4ab9-b51a-84a7915d80ef req-259e7500-5e14-43cc-b745-35d30b30ddc5 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:06.097572 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.compute.server_external_events [req-5e1c8ffc-ee74-4ab9-b51a-84a7915d80ef req-259e7500-5e14-43cc-b745-35d30b30ddc5 service nova] Creating event network-changed:3d6e600d-e074-446d-9be0-9d94d8296f2e for instance 745a7875-3650-44fe-bdc7-5d9be2202641 on hv-cinder-maste Oct 30 01:21:06.103084 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [req-5e1c8ffc-ee74-4ab9-b51a-84a7915d80ef req-259e7500-5e14-43cc-b745-35d30b30ddc5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037218 Oct 30 01:21:06.103808 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 486/976] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:06.619387 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:06.620025 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:06.627474 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:06.628626 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:06.629131 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:06.629835 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:06.630295 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:06.630723 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:06.766477 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:06.774218 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-1b8ac5c2-f855-4cf9-9762-10e5e9d97759 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.158763 Oct 30 01:21:06.774782 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 491/977] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:06 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:07.800039 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:07.801339 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:07.808211 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:07.808689 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:07.809116 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:07.809808 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:07.810257 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:07.810672 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:07.946613 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:07.954266 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6be8c8da-ab0b-48a6-b11b-9706a79e0351 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.160373 Oct 30 01:21:07.954830 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 487/978] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:07 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:08.978288 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:08.978874 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:08.986546 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.987039 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.987476 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:08.988201 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.989231 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.989649 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.131001 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.138755 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-9f90a37c-15eb-4da4-91be-8f30e3e6dc27 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.164612 Oct 30 01:21:09.139322 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 492/979] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:08 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:10.162477 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:10.163068 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:10.169770 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.170255 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.170695 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.171499 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.171992 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.172421 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.307275 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:10.314832 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-20ddfb76-a16b-4a36-b3c2-78dcdd92a4e7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.156288 Oct 30 01:21:10.315438 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 488/980] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:10 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:11.339005 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:11.339620 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:11.341974 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG dbcounter [-] [119523] Writing DB stats nova_cell0:SELECT=2 {{(pid=119523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:11.346736 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.347217 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.347681 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.348371 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.348906 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.349388 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.483326 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:11.491665 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-feafc439-a004-42aa-81c8-5d0f8f3d6f60 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.156686 Oct 30 01:21:11.492234 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 493/981] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:11 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:12.516561 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:12.517137 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:12.519052 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=2 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:12.520250 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG dbcounter [-] [119524] Writing DB stats nova_cell0:SELECT=8 {{(pid=119524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:12.525621 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.526102 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.526535 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.527271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.527782 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.528279 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.679424 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.687693 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-6e884063-815b-49e3-82d9-c66dc3d61877 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.175020 Oct 30 01:21:12.688403 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 489/982] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:12 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:12.814308 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-5e7b8910-3d77-4cb7-9cfa-4fe48cf6b477 req-716a1051-1b84-4862-bf52-28db81e47ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745a7875-3650-44fe-bdc7-5d9be2202641", "name": "network-vif-plugged", "status": "completed", "tag": "3d6e600d-e074-446d-9be0-9d94d8296f2e"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:12.825847 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-5e7b8910-3d77-4cb7-9cfa-4fe48cf6b477 req-716a1051-1b84-4862-bf52-28db81e47ffe service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.826424 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-5e7b8910-3d77-4cb7-9cfa-4fe48cf6b477 req-716a1051-1b84-4862-bf52-28db81e47ffe service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.826930 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-5e7b8910-3d77-4cb7-9cfa-4fe48cf6b477 req-716a1051-1b84-4862-bf52-28db81e47ffe service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.840702 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-5e7b8910-3d77-4cb7-9cfa-4fe48cf6b477 req-716a1051-1b84-4862-bf52-28db81e47ffe service nova] Creating event network-vif-plugged:3d6e600d-e074-446d-9be0-9d94d8296f2e for instance 745a7875-3650-44fe-bdc7-5d9be2202641 on hv-cinder-maste Oct 30 01:21:12.845026 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-5e7b8910-3d77-4cb7-9cfa-4fe48cf6b477 req-716a1051-1b84-4862-bf52-28db81e47ffe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159196 Oct 30 01:21:12.845680 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 494/983] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:13.712623 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:13.713240 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:13.720182 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.720675 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.721115 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.721823 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.722292 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.722712 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.858857 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:13.866387 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-689cfb9d-7cac-4951-9f2f-cde0a09025a0 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1314 microversion: 2.1 time: 0.158714 Oct 30 01:21:13.867465 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 490/984] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:13 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:14.891871 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:14.892571 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:14.898878 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:14.899516 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:14.899977 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:14.900708 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:14.901190 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:14.901614 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.124237 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.132338 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-853c0621-8460-418a-9f39-65a5cd1049a7 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1463 microversion: 2.1 time: 0.245528 Oct 30 01:21:15.132911 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 495/985] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:14 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:15.180718 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:15.181280 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:15.187737 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.188230 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.188663 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.189379 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.189822 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.190356 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.216952 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Going to try to terminate instance {{(pid=119524) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:15.516798 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-0aa8f0d8-ac6e-4b09-9b1a-3177ba330346 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "DELETE /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 204 len: 0 microversion: 2.1 time: 0.339782 Oct 30 01:21:15.517333 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 491/986] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:15 2022] DELETE /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:15.526518 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:15.527403 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:15.533661 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.534146 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.534582 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.535279 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.535771 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.536197 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.685820 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.policy [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119523) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.693364 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-732ec720-aace-4746-a6ff-5f6a077bdb44 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1469 microversion: 2.1 time: 0.171582 Oct 30 01:21:15.693914 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 496/987] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:15 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:16.717292 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:16.717985 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:16.724531 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.725011 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.725438 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.726127 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.726575 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.726990 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.861045 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:16.872404 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-3f32f2f2-1104-4e08-883b-76a2386446fe tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1469 microversion: 2.1 time: 0.158651 Oct 30 01:21:16.873233 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 492/988] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:16 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:17.690975 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [req-275b1216-2684-4154-aa7b-57aa4e5cedda req-1e674f10-614a-4562-a837-6e5c7b7da9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745a7875-3650-44fe-bdc7-5d9be2202641", "name": "network-vif-deleted", "tag": "3d6e600d-e074-446d-9be0-9d94d8296f2e"}]} {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:17.701957 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-275b1216-2684-4154-aa7b-57aa4e5cedda req-1e674f10-614a-4562-a837-6e5c7b7da9b3 service nova] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.702484 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-275b1216-2684-4154-aa7b-57aa4e5cedda req-1e674f10-614a-4562-a837-6e5c7b7da9b3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.702907 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [req-275b1216-2684-4154-aa7b-57aa4e5cedda req-1e674f10-614a-4562-a837-6e5c7b7da9b3 service nova] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.715406 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.compute.server_external_events [req-275b1216-2684-4154-aa7b-57aa4e5cedda req-1e674f10-614a-4562-a837-6e5c7b7da9b3 service nova] Creating event network-vif-deleted:3d6e600d-e074-446d-9be0-9d94d8296f2e for instance 745a7875-3650-44fe-bdc7-5d9be2202641 on hv-cinder-maste Oct 30 01:21:17.720644 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [req-275b1216-2684-4154-aa7b-57aa4e5cedda req-1e674f10-614a-4562-a837-6e5c7b7da9b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033467 Oct 30 01:21:17.721531 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 497/989] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:17.897617 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.api.openstack.wsgi [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:17.898392 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.compute.api [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119524) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:17.905667 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.906171 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.906609 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.908016 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.908464 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.908893 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG oslo_concurrency.lockutils [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.972271 dv-cinder-master-3-smb devstack@n-api.service[119524]: DEBUG nova.policy [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62335db37664c68802042ff7c22fc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc5163150b440ebb6e60097378e2274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119524) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:17.980806 dv-cinder-master-3-smb devstack@n-api.service[119524]: INFO nova.api.openstack.requestlog [None req-b3ddd803-4ecf-4786-a77d-682da024c078 tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 200 len: 1299 microversion: 2.1 time: 0.087361 Oct 30 01:21:17.981368 dv-cinder-master-3-smb devstack@n-api.service[119524]: [pid: 119524|app: 0|req: 493/990] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:17 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:19.005579 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Calling method '>' {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:19.006301 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.compute.api [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] [instance: 745a7875-3650-44fe-bdc7-5d9be2202641] Fetching instance by UUID {{(pid=119523) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:19.012554 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:19.013042 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:19.013472 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:19.014163 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Acquiring lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:19.014618 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:19.015039 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG oslo_concurrency.lockutils [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Lock "981e4b1c-a815-41e8-a403-49a91c7c17f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:19.029055 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.wsgi [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] HTTP exception thrown: Instance 745a7875-3650-44fe-bdc7-5d9be2202641 could not be found. Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Request method failure captured: Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: request: GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 HTTP/1.1 Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept: application/json Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: Accept-Encoding: identity Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: Connection: close Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Length: 0 Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: Content-Type: application/json Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: Host: 10.222.0.26 Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: Openstack-System-Scope: None Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Auth-Token: gAAAAABjXdF6tjNffCekL9YTWZFIWjt49DKO2L2fSoW7M6eaUEX07AanLKlr7SQv6YYLTsU-2IVw7qInxFIfYXl2T8OEtMyAgTYX2czkI4YOUTttjhL-2u8Gno87Ohrr4z_R2x441J6AEXkM2lLwNl5fqXshbo0UtyX73P5cwFQ3HynIhvqo9aQ Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Id: None Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Domain-Name: None Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Identity-Status: Confirmed Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Is-Admin-Project: True Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Id: default Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Domain-Name: Default Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Id: 5fc5163150b440ebb6e60097378e2274 Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Project-Name: tempest-VolumesNegativeTest-1244963711 Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Role: reader,member Oct 30 01:21:19.032525 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Roles: reader,member Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fc5163150b440ebb6e60097378e2274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fc5163150b440ebb6e60097378e2274"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fc5163150b440ebb6e60097378e2274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fc5163150b440ebb6e60097378e2274"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant: tempest-VolumesNegativeTest-1244963711 Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Id: 5fc5163150b440ebb6e60097378e2274 Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-Tenant-Name: tempest-VolumesNegativeTest-1244963711 Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User: tempest-VolumesNegativeTest-1244963711-project Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Id: default Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Domain-Name: Default Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Id: b62335db37664c68802042ff7c22fc33 Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: X-User-Name: tempest-VolumesNegativeTest-1244963711-project Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: method: > Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: exception: Instance 745a7875-3650-44fe-bdc7-5d9be2202641 could not be found. Oct 30 01:21:19.034293 dv-cinder-master-3-smb devstack@n-api.service[119523]: action_args: {'id': '745a7875-3650-44fe-bdc7-5d9be2202641'} Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: {{(pid=119523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745a7875-3650-44fe-bdc7-5d9be2202641 could not be found. Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:19.035314 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745a7875-3650-44fe-bdc7-5d9be2202641 could not be found. Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745a7875-3650-44fe-bdc7-5d9be2202641 could not be found. Oct 30 01:21:19.036971 dv-cinder-master-3-smb devstack@n-api.service[119523]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.038399 dv-cinder-master-3-smb devstack@n-api.service[119523]: DEBUG nova.api.openstack.wsgi [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] Returning 404 to user: Instance 745a7875-3650-44fe-bdc7-5d9be2202641 could not be found. {{(pid=119523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:19.038399 dv-cinder-master-3-smb devstack@n-api.service[119523]: INFO nova.api.openstack.requestlog [None req-ca8d5c51-c73d-4fad-a45f-28f80d2b6fce tempest-VolumesNegativeTest-1244963711 tempest-VolumesNegativeTest-1244963711-project] 10.222.0.26 "GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641" status: 404 len: 111 microversion: 2.1 time: 0.031330 Oct 30 01:21:19.038399 dv-cinder-master-3-smb devstack@n-api.service[119523]: [pid: 119523|app: 0|req: 498/991] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:18 2022] GET /compute/v2.1/servers/745a7875-3650-44fe-bdc7-5d9be2202641 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)